Oct 18 07:03:00 user nova-compute[74587]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74587) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74587) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74587) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 18 07:03:00 user nova-compute[74587]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:03:00 user nova-compute[74587]: INFO nova.virt.driver [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 18 07:03:00 user nova-compute[74587]: INFO nova.compute.provider_config [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] Acquiring lock "singleton_lock" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] Acquired lock "singleton_lock" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] Releasing lock "singleton_lock" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] Full set of CONF: {{(pid=74587) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ******************************************************************************** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] Configuration options gathered from: {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ================================================================================ {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] allow_resize_to_same_host      = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] arq_binding_timeout            = 300 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] backdoor_port                  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] backdoor_socket                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] block_device_allocate_retries  = 300 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] block_device_allocate_retries_interval = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cert                           = self.pem {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute_monitors               = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] config_dir                     = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] config_drive_format            = iso9660 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] config_source                  = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] console_host                   = user {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] control_exchange               = nova {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cpu_allocation_ratio           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] daemon                         = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] debug                          = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] default_access_ip_network_name = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] default_availability_zone      = nova {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] default_ephemeral_format       = ext4 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] default_green_pool_size        = 1000 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] default_schedule_zone          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] disk_allocation_ratio          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] enable_new_services            = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] enabled_ssl_apis               = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] flat_injected                  = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] force_config_drive             = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] force_raw_images               = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] graceful_shutdown_timeout      = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] heal_instance_info_cache_interval = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] host                           = user {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] instance_build_timeout         = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] instance_delete_interval       = 300 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] instance_name_template         = instance-%08x {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] instance_usage_audit           = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] instance_usage_audit_period    = month {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] internal_service_availability_zone = internal {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] key                            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] live_migration_retry_count     = 30 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] log_config_append              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] log_dir                        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] log_file                       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] log_options                    = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] log_rotate_interval            = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] log_rotate_interval_type       = days {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] log_rotation_type              = none {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] long_rpc_timeout               = 1800 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] max_concurrent_builds          = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] max_concurrent_live_migrations = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] max_concurrent_snapshots       = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] max_local_block_devices        = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] max_logfile_count              = 30 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] max_logfile_size_mb            = 200 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] maximum_instance_delete_attempts = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] metadata_listen                = 0.0.0.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] metadata_listen_port           = 8775 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] metadata_workers               = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] migrate_max_retries            = -1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] mkisofs_cmd                    = genisoimage {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] my_ip                          = 10.0.0.210 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] network_allocate_retries       = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] osapi_compute_listen_port      = 8774 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] osapi_compute_unique_server_name_scope =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] osapi_compute_workers          = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] password_length                = 12 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] periodic_enable                = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] periodic_fuzzy_delay           = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] pointer_model                  = ps2mouse {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] preallocate_images             = none {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] publish_errors                 = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] pybasedir                      = /opt/stack/nova {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ram_allocation_ratio           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] rate_limit_burst               = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] rate_limit_except_level        = CRITICAL {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] rate_limit_interval            = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] reboot_timeout                 = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] reclaim_instance_interval      = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] record                         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] reimage_timeout_per_gb         = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] report_interval                = 120 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] rescue_timeout                 = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] reserved_host_cpus             = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] reserved_host_disk_mb          = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] reserved_host_memory_mb        = 512 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] reserved_huge_pages            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] resize_confirm_window          = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] resize_fs_using_block_device   = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] resume_guests_state_on_host_boot = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] rpc_response_timeout           = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] run_external_periodic_tasks    = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] running_deleted_instance_action = reap {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] running_deleted_instance_timeout = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler_instance_sync_interval = 120 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_down_time              = 720 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] servicegroup_driver            = db {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] shelved_offload_time           = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] shelved_poll_interval          = 3600 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] shutdown_timeout               = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] source_is_ipv6                 = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ssl_only                       = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] state_path                     = /opt/stack/data/nova {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] sync_power_state_interval      = 600 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] sync_power_state_pool_size     = 1000 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] syslog_log_facility            = LOG_USER {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] tempdir                        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] timeout_nbd                    = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] transport_url                  = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] update_resources_interval      = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] use_cow_images                 = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] use_eventlog                   = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] use_journal                    = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] use_json                       = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] use_rootwrap_daemon            = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] use_stderr                     = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] use_syslog                     = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vcpu_pin_set                   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plugging_is_fatal          = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plugging_timeout           = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] virt_mkfs                      = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] volume_usage_poll_interval     = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] watch_log_file                 = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] web                            = /usr/share/spice-html5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_concurrency.disable_process_locking = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.auth_strategy              = keystone {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.compute_link_prefix        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.dhcp_domain                = novalocal {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.enable_instance_password   = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.glance_link_prefix         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.instance_list_per_project_cells = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.list_records_by_skipping_down_cells = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.local_metadata_per_cell    = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.max_limit                  = 1000 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.metadata_cache_expiration  = 15 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.neutron_default_tenant_id  = default {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.use_forwarded_for          = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.use_neutron_default_nets   = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.vendordata_dynamic_targets = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.vendordata_jsonfile_path   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.backend_argument         = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.config_prefix            = cache.oslo {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.dead_timeout             = 60.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.debug_cache_backend      = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.enable_retry_client      = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.enable_socket_keepalive  = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.enabled                  = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.expiration_time          = 600 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.hashclient_retry_attempts = 2 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.memcache_dead_retry      = 300 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.memcache_password        =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.memcache_sasl_enabled    = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.memcache_username        =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.proxies                  = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.retry_attempts           = 2 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.retry_delay              = 0.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.socket_keepalive_count   = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.socket_keepalive_idle    = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.socket_keepalive_interval = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.tls_allowed_ciphers      = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.tls_cafile               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.tls_certfile             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.tls_enabled              = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cache.tls_keyfile              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.auth_section            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.auth_type               = password {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.cafile                  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.certfile                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.collect_timing          = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.cross_az_attach         = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.debug                   = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.endpoint_template       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.http_retries            = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.insecure                = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.keyfile                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.os_region_name          = RegionOne {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.split_loggers           = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cinder.timeout                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.cpu_dedicated_set      = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.cpu_shared_set         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.image_type_exclude_list = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.resource_provider_association_refresh = 300 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.shutdown_retry_interval = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] conductor.workers              = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] console.allowed_origins        = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] console.ssl_ciphers            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] console.ssl_minimum_version    = default {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] consoleauth.token_ttl          = 600 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.cafile                  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.certfile                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.collect_timing          = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.connect_retries         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.connect_retry_delay     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.endpoint_override       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.insecure                = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.keyfile                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.max_version             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.min_version             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.region_name             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.service_name            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.service_type            = accelerator {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.split_loggers           = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.status_code_retries     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.status_code_retry_delay = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.timeout                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] cyborg.version                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.backend               = sqlalchemy {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.connection            = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.connection_debug      = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.connection_parameters =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.connection_recycle_time = 3600 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.connection_trace      = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.db_inc_retry_interval = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.db_max_retries        = 20 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.db_max_retry_interval = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.db_retry_interval     = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.max_overflow          = 50 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.max_pool_size         = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.max_retries           = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.mysql_wsrep_sync_wait = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.pool_timeout          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.retry_interval        = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.slave_connection      = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] database.sqlite_synchronous    = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.backend           = sqlalchemy {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.connection        = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.connection_debug  = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.connection_parameters =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.connection_recycle_time = 3600 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.connection_trace  = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.db_inc_retry_interval = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.db_max_retries    = 20 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.db_max_retry_interval = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.db_retry_interval = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.max_overflow      = 50 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.max_pool_size     = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.max_retries       = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.pool_timeout      = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.retry_interval    = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.slave_connection  = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] api_database.sqlite_synchronous = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] devices.enabled_mdev_types     = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ephemeral_storage_encryption.enabled = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.api_servers             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.cafile                  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.certfile                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.collect_timing          = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.connect_retries         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.connect_retry_delay     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.debug                   = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.default_trusted_certificate_ids = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.enable_certificate_validation = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.enable_rbd_download     = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.endpoint_override       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.insecure                = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.keyfile                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.max_version             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.min_version             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.num_retries             = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.rbd_ceph_conf           =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.rbd_connect_timeout     = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.rbd_pool                =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.rbd_user                =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.region_name             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.service_name            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.service_type            = image {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.split_loggers           = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.status_code_retries     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.status_code_retry_delay = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.timeout                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.verify_glance_signatures = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] glance.version                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] guestfs.debug                  = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.config_drive_cdrom      = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.config_drive_inject_password = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.enable_remotefx         = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.instances_path_share    =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.limit_cpu_features      = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.use_multipath_io        = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.vswitch_name            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] mks.enabled                    = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] image_cache.manager_interval   = 2400 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] image_cache.precache_concurrency = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] image_cache.remove_unused_base_images = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] image_cache.subdirectory_name  = _base {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.api_max_retries         = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.api_retry_interval      = 2 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.auth_section            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.auth_type               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.cafile                  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.certfile                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.collect_timing          = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.conductor_group         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.connect_retries         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.connect_retry_delay     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.endpoint_override       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.insecure                = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.keyfile                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.max_version             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.min_version             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.peer_list               = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.region_name             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.serial_console_state_timeout = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.service_name            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.service_type            = baremetal {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.split_loggers           = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.status_code_retries     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.status_code_retry_delay = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.timeout                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ironic.version                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] key_manager.fixed_key          = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.barbican_api_version  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.barbican_endpoint     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.barbican_endpoint_type = public {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.barbican_region_name  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.cafile                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.certfile              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.collect_timing        = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.insecure              = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.keyfile               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.number_of_retries     = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.retry_delay           = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.send_service_user_token = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.split_loggers         = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.timeout               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.verify_ssl            = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican.verify_ssl_path       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican_service_user.auth_section = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican_service_user.auth_type = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican_service_user.cafile   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican_service_user.certfile = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican_service_user.collect_timing = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican_service_user.insecure = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican_service_user.keyfile  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican_service_user.split_loggers = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] barbican_service_user.timeout  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.approle_role_id          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.approle_secret_id        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.cafile                   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.certfile                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.collect_timing           = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.insecure                 = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.keyfile                  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.kv_mountpoint            = secret {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.kv_path                  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.kv_version               = 2 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.namespace                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.root_token_id            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.split_loggers            = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.ssl_ca_crt_file          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.timeout                  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.use_ssl                  = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.auth_section          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.auth_type             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.cafile                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.certfile              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.collect_timing        = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.connect_retries       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.connect_retry_delay   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.endpoint_override     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.insecure              = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.keyfile               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.max_version           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.min_version           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.region_name           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.service_name          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.service_type          = identity {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.split_loggers         = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.status_code_retries   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.status_code_retry_delay = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.timeout               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] keystone.version               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.connection_uri         =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.cpu_mode               = custom {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: WARNING oslo_config.cfg [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.cpu_power_governor_high = performance {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.cpu_power_management   = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.device_detach_attempts = 8 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.device_detach_timeout  = 20 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.disk_cachemodes        = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.disk_prefix            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.enabled_perf_events    = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.file_backed_memory     = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.gid_maps               = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.hw_disk_discard        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.hw_machine_type        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.images_rbd_pool        = rbd {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.images_type            = default {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.images_volume_group    = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.inject_key             = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.inject_partition       = -2 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.inject_password        = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.iscsi_iface            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.iser_use_multipath     = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_downtime = 500 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_inbound_addr = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_scheme  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_timeout_action = abort {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_tunnelled = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: WARNING oslo_config.cfg [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 18 07:03:00 user nova-compute[74587]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 18 07:03:00 user nova-compute[74587]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 18 07:03:00 user nova-compute[74587]: and ``live_migration_inbound_addr`` respectively.
Oct 18 07:03:00 user nova-compute[74587]: ).  Its value may be silently ignored in the future.
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.live_migration_with_native_tls = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.max_queues             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.nfs_mount_options      = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.num_pcie_ports         = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.pmem_namespaces        = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.quobyte_client_cfg     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.rbd_secret_uuid        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.rbd_user               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.rescue_image_id        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.rescue_kernel_id       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.rx_queue_size          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.smbfs_mount_options    =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.snapshot_compression   = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.snapshot_image_format  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.sparse_logical_volumes = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.swtpm_enabled          = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.swtpm_group            = tss {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.swtpm_user             = tss {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.sysinfo_serial         = unique {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.tb_cache_size          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.tx_queue_size          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.uid_maps               = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.use_virtio_for_bridges = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.virt_type              = kvm {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.volume_clear           = zero {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.volume_clear_size      = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.volume_use_multipath   = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.vzstorage_cache_path   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.auth_section           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.auth_type              = password {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.cafile                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.certfile               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.collect_timing         = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.connect_retries        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.connect_retry_delay    = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.default_floating_pool  = public {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.endpoint_override      = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.extension_sync_interval = 600 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.http_retries           = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.insecure               = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.keyfile                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.max_version            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.min_version            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.ovs_bridge             = br-int {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.physnets               = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.region_name            = RegionOne {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.service_metadata_proxy = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.service_name           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.service_type           = network {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.split_loggers          = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.status_code_retries    = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.status_code_retry_delay = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.timeout                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] neutron.version                = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] notifications.bdms_in_notifications = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] notifications.default_level    = INFO {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] notifications.notification_format = unversioned {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] notifications.notify_on_state_change = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] pci.alias                      = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] pci.device_spec                = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] pci.report_in_placement        = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.auth_section         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.auth_type            = password {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.cafile               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.certfile             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.collect_timing       = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.connect_retries      = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.connect_retry_delay  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.default_domain_id    = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.default_domain_name  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.domain_id            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.domain_name          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.endpoint_override    = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.insecure             = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.keyfile              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.max_version          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.min_version          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.password             = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.project_domain_id    = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.project_domain_name  = Default {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.project_id           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.project_name         = service {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.region_name          = RegionOne {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.service_name         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.service_type         = placement {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.split_loggers        = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.status_code_retries  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.status_code_retry_delay = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.system_scope         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.timeout              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.trust_id             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.user_domain_id       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.user_domain_name     = Default {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.user_id              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.username             = placement {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] placement.version              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.cores                    = 20 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.count_usage_from_placement = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.injected_file_content_bytes = 10240 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.injected_file_path_length = 255 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.injected_files           = 5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.instances                = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.key_pairs                = 100 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.metadata_items           = 128 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.ram                      = 51200 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.recheck_quota            = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.server_group_members     = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] quota.server_groups            = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] rdp.enabled                    = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler.image_metadata_prefilter = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler.max_attempts         = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler.max_placement_results = 1000 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] scheduler.workers              = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.host_subset_size = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.isolated_hosts = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.isolated_images = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.pci_in_placement = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.track_instance_changes = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] metrics.required               = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] metrics.weight_multiplier      = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] metrics.weight_setting         = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] serial_console.enabled         = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] serial_console.port_range      = 10000:20000 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] serial_console.serialproxy_port = 6083 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_user.auth_section      = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_user.auth_type         = password {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_user.cafile            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_user.certfile          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_user.collect_timing    = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_user.insecure          = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_user.keyfile           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_user.send_service_user_token = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_user.split_loggers     = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] service_user.timeout           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.agent_enabled            = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.enabled                  = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.html5proxy_port          = 6082 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.image_compression        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.jpeg_compression         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.playback_compression     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.server_listen            = 127.0.0.1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.streaming_mode           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] spice.zlib_compression         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] upgrade_levels.baseapi         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] upgrade_levels.cert            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] upgrade_levels.compute         = auto {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] upgrade_levels.conductor       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] upgrade_levels.scheduler       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vendordata_dynamic_auth.cafile = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vendordata_dynamic_auth.certfile = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vendordata_dynamic_auth.insecure = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vendordata_dynamic_auth.timeout = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.api_retry_count         = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.ca_file                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.cache_prefix            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.cluster_name            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.connection_pool_size    = 10 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.console_delay_seconds   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.datastore_regex         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.host_ip                 = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.host_password           = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.host_port               = 443 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.host_username           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.insecure                = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.integration_bridge      = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.maximum_objects         = 100 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.pbm_default_policy      = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.pbm_enabled             = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.pbm_wsdl_location       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.serial_port_proxy_uri   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.serial_port_service_uri = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.task_poll_interval      = 0.5 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.use_linked_clone        = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.vnc_keymap              = en-us {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.vnc_port                = 5900 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vmware.vnc_port_total          = 10000 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vnc.auth_schemes               = ['none'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vnc.enabled                    = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vnc.novncproxy_port            = 6080 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vnc.vencrypt_ca_certs          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vnc.vencrypt_client_cert       = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vnc.vencrypt_client_key        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.disable_rootwrap   = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.enable_numa_live_migration = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.libvirt_disable_apic = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.client_socket_timeout     = 900 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.default_pool_size         = 1000 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.keep_alive                = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.max_header_line           = 16384 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.ssl_ca_file               = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.ssl_cert_file             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.ssl_key_file              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.tcp_keepidle              = 600 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] zvm.ca_file                    = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] zvm.cloud_connector_url        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] zvm.reachable_timeout          = 300 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_policy.enforce_new_defaults = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_policy.enforce_scope      = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_policy.policy_default_rule = default {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.connection_string     = messaging:// {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.enabled               = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.es_doc_type           = notification {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.es_scroll_size        = 10000 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.es_scroll_time        = 2m {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.filter_error_trace    = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.hmac_keys             = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.sentinel_service_name = mymaster {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.socket_timeout        = 0.1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.trace_requests        = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler.trace_sqlalchemy      = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler_jaeger.process_tags   = {} {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler_jaeger.service_name_prefix = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] profiler_otlp.service_name_prefix = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] remote_debug.host              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] remote_debug.port              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_notifications.retry = -1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.auth_section        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.auth_type           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.cafile              = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.certfile            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.collect_timing      = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.connect_retries     = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.connect_retry_delay = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.endpoint_id         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.endpoint_override   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.insecure            = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.keyfile             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.max_version         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.min_version         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.region_name         = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.service_name        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.service_type        = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.split_loggers       = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.status_code_retries = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.status_code_retry_delay = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.timeout             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.valid_interfaces    = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_limit.version             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_reports.file_event_handler = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] oslo_reports.log_dir           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_ovs_privileged.group  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] vif_plug_ovs_privileged.user   = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_ovs.isolate_vif         = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] os_brick.lock_path             = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] privsep_osbrick.capabilities   = [21] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] privsep_osbrick.group          = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] privsep_osbrick.helper_command = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] privsep_osbrick.user           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] nova_sys_admin.group           = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] nova_sys_admin.helper_command  = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] nova_sys_admin.user            = None {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 07:03:00 user nova-compute[74587]: DEBUG oslo_service.service [None req-a2a258bd-9e75-4e55-ab2d-a0c5e1d16160 None None] ******************************************************************************** {{(pid=74587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 18 07:03:00 user nova-compute[74587]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 18 07:03:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Connecting to libvirt: qemu:///system {{(pid=74587) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 18 07:03:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f102010d300> {{(pid=74587) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 18 07:03:01 user nova-compute[74587]: libvirt:  error : internal error: could not initialize domain event timer
Oct 18 07:03:01 user nova-compute[74587]: WARNING nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 18 07:03:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f102010d300> {{(pid=74587) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 18 07:03:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Starting native event thread {{(pid=74587) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 18 07:03:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Starting green dispatch thread {{(pid=74587) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 18 07:03:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Starting connection event dispatch thread {{(pid=74587) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 18 07:03:01 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Connection event '1' reason 'None'
Oct 18 07:03:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 18 07:03:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.mount [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Initialising _HostMountState generation 0 {{(pid=74587) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 18 07:03:08 user nova-compute[74587]: INFO nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Libvirt host capabilities <capabilities>
Oct 18 07:03:08 user nova-compute[74587]:   <host>
Oct 18 07:03:08 user nova-compute[74587]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 18 07:03:08 user nova-compute[74587]:     <cpu>
Oct 18 07:03:08 user nova-compute[74587]:       <arch>x86_64</arch>
Oct 18 07:03:08 user nova-compute[74587]:       <model>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <vendor>Intel</vendor>
Oct 18 07:03:08 user nova-compute[74587]:       <microcode version='1070'/>
Oct 18 07:03:08 user nova-compute[74587]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 18 07:03:08 user nova-compute[74587]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='ss'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='vmx'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='pcid'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='osxsave'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='hypervisor'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='arat'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='tsc_adjust'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='md-clear'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='arch-capabilities'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='invtsc'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='rsba'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature name='skip-l1dfl-vmentry'/>
Oct 18 07:03:08 user nova-compute[74587]:       <pages unit='KiB' size='4'/>
Oct 18 07:03:08 user nova-compute[74587]:       <pages unit='KiB' size='2048'/>
Oct 18 07:03:08 user nova-compute[74587]:     </cpu>
Oct 18 07:03:08 user nova-compute[74587]:     <power_management>
Oct 18 07:03:08 user nova-compute[74587]:       <suspend_mem/>
Oct 18 07:03:08 user nova-compute[74587]:       <suspend_disk/>
Oct 18 07:03:08 user nova-compute[74587]:       <suspend_hybrid/>
Oct 18 07:03:08 user nova-compute[74587]:     </power_management>
Oct 18 07:03:08 user nova-compute[74587]:     <iommu support='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     <migration_features>
Oct 18 07:03:08 user nova-compute[74587]:       <live/>
Oct 18 07:03:08 user nova-compute[74587]:       <uri_transports>
Oct 18 07:03:08 user nova-compute[74587]:         <uri_transport>tcp</uri_transport>
Oct 18 07:03:08 user nova-compute[74587]:         <uri_transport>rdma</uri_transport>
Oct 18 07:03:08 user nova-compute[74587]:       </uri_transports>
Oct 18 07:03:08 user nova-compute[74587]:     </migration_features>
Oct 18 07:03:08 user nova-compute[74587]:     <topology>
Oct 18 07:03:08 user nova-compute[74587]:       <cells num='2'>
Oct 18 07:03:08 user nova-compute[74587]:         <cell id='0'>
Oct 18 07:03:08 user nova-compute[74587]:           <memory unit='KiB'>8189224</memory>
Oct 18 07:03:08 user nova-compute[74587]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 18 07:03:08 user nova-compute[74587]:           <pages unit='KiB' size='2048'>0</pages>
Oct 18 07:03:08 user nova-compute[74587]:           <distances>
Oct 18 07:03:08 user nova-compute[74587]:             <sibling id='0' value='10'/>
Oct 18 07:03:08 user nova-compute[74587]:             <sibling id='1' value='20'/>
Oct 18 07:03:08 user nova-compute[74587]:           </distances>
Oct 18 07:03:08 user nova-compute[74587]:           <cpus num='6'>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 18 07:03:08 user nova-compute[74587]:           </cpus>
Oct 18 07:03:08 user nova-compute[74587]:         </cell>
Oct 18 07:03:08 user nova-compute[74587]:         <cell id='1'>
Oct 18 07:03:08 user nova-compute[74587]:           <memory unit='KiB'>8206460</memory>
Oct 18 07:03:08 user nova-compute[74587]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 18 07:03:08 user nova-compute[74587]:           <pages unit='KiB' size='2048'>0</pages>
Oct 18 07:03:08 user nova-compute[74587]:           <distances>
Oct 18 07:03:08 user nova-compute[74587]:             <sibling id='0' value='20'/>
Oct 18 07:03:08 user nova-compute[74587]:             <sibling id='1' value='10'/>
Oct 18 07:03:08 user nova-compute[74587]:           </distances>
Oct 18 07:03:08 user nova-compute[74587]:           <cpus num='6'>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 18 07:03:08 user nova-compute[74587]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 18 07:03:08 user nova-compute[74587]:           </cpus>
Oct 18 07:03:08 user nova-compute[74587]:         </cell>
Oct 18 07:03:08 user nova-compute[74587]:       </cells>
Oct 18 07:03:08 user nova-compute[74587]:     </topology>
Oct 18 07:03:08 user nova-compute[74587]:     <cache>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 18 07:03:08 user nova-compute[74587]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 18 07:03:08 user nova-compute[74587]:     </cache>
Oct 18 07:03:08 user nova-compute[74587]:     <secmodel>
Oct 18 07:03:08 user nova-compute[74587]:       <model>apparmor</model>
Oct 18 07:03:08 user nova-compute[74587]:       <doi>0</doi>
Oct 18 07:03:08 user nova-compute[74587]:     </secmodel>
Oct 18 07:03:08 user nova-compute[74587]:     <secmodel>
Oct 18 07:03:08 user nova-compute[74587]:       <model>dac</model>
Oct 18 07:03:08 user nova-compute[74587]:       <doi>0</doi>
Oct 18 07:03:08 user nova-compute[74587]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 18 07:03:08 user nova-compute[74587]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 18 07:03:08 user nova-compute[74587]:     </secmodel>
Oct 18 07:03:08 user nova-compute[74587]:   </host>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='alpha'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>clipper</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='armv6l'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>integratorcp</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>borzoi</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>spitz</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>nuri</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>musca-b1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>versatileab</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>kzm</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>musca-a</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>smdkc210</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sx1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>z2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>tosa</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>sabrelite</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>realview-eb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>n810</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>n800</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>versatilepb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>terrier</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mainstone</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>midway</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>musicpal</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>microbit</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>cubieboard</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>verdex</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>netduino2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>raspi2b</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>cheetah</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>highbank</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>akita</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>connex</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>collie</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>raspi0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='armv7l'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>integratorcp</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>borzoi</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>spitz</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>nuri</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>musca-b1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>versatileab</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>kzm</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>musca-a</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>smdkc210</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sx1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>z2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>tosa</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>sabrelite</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>realview-eb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>n810</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>n800</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>versatilepb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>terrier</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mainstone</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>midway</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>musicpal</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>microbit</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>cubieboard</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>verdex</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>netduino2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>raspi2b</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>cheetah</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>highbank</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>akita</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>connex</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>collie</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>raspi0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='aarch64'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>integratorcp</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>borzoi</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>spitz</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>nuri</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>musca-b1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>versatileab</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>kzm</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>musca-a</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>smdkc210</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sx1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>z2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>tosa</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>sabrelite</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>realview-eb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>n810</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>n800</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>versatilepb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>terrier</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mainstone</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>midway</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>musicpal</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>microbit</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>cubieboard</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>verdex</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>netduino2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>raspi3b</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>raspi2b</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>cheetah</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>highbank</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>akita</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>connex</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>collie</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>raspi0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <acpi default='on' toggle='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='cris'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='i686'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>x-remote</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>isapc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>microvm</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='kvm'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <pae/>
Oct 18 07:03:08 user nova-compute[74587]:       <nonpae/>
Oct 18 07:03:08 user nova-compute[74587]:       <acpi default='on' toggle='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:       <apic default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='m68k'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>an5206</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>q800</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>next-cube</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='microblaze'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='microblazeel'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='mips'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='16'>malta</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mipssim</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='mipsel'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='16'>malta</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mipssim</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='mips64'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='16'>malta</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mipssim</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>pica61</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>magnum</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='mips64el'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='16'>malta</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mipssim</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>pica61</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>magnum</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='16'>boston</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='ppc'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>g3beige</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mac99</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>ppce500</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>pegasos2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sam460ex</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>bamboo</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>40p</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>ref405ep</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>taihu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='ppc64'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2048'>powernv9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>taihu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2048'>powernv10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>ppce500</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>40p</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>pegasos2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>bamboo</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>g3beige</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mac99</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sam460ex</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>ref405ep</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2048'>powernv8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='ppc64le'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2048'>powernv9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>taihu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2048'>powernv10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>ppce500</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>40p</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>pegasos2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>bamboo</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>g3beige</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>mac99</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sam460ex</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>ref405ep</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2048'>powernv8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='riscv32'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='8'>spike</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>opentitan</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='5'>sifive_u</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sifive_e</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='8'>virt</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='riscv64'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='8'>spike</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='5'>sifive_u</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>shakti_c</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sifive_e</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='8'>virt</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='s390x'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='sh4'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>shix</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>r2d</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='sh4eb'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>shix</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>r2d</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='sparc'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>SS-5</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>SS-20</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>LX</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>SS-4</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>SS-10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>Voyager</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='sparc64'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sun4u</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>niagara</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>sun4v</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='x86_64'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>64</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>x-remote</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='1'>isapc</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>microvm</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='kvm'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <acpi default='on' toggle='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:       <apic default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='xtensa'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>sim</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>kc705</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>ml605</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>virt</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>lx200</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>lx60</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]:   <guest>
Oct 18 07:03:08 user nova-compute[74587]:     <os_type>hvm</os_type>
Oct 18 07:03:08 user nova-compute[74587]:     <arch name='xtensaeb'>
Oct 18 07:03:08 user nova-compute[74587]:       <wordsize>32</wordsize>
Oct 18 07:03:08 user nova-compute[74587]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='4'>sim</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>kc705</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>ml605</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>virt</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>lx200</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>lx60</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 18 07:03:08 user nova-compute[74587]:       <domain type='qemu'/>
Oct 18 07:03:08 user nova-compute[74587]:     </arch>
Oct 18 07:03:08 user nova-compute[74587]:     <features>
Oct 18 07:03:08 user nova-compute[74587]:       <cpuselection/>
Oct 18 07:03:08 user nova-compute[74587]:       <deviceboot/>
Oct 18 07:03:08 user nova-compute[74587]:       <disksnapshot default='on' toggle='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     </features>
Oct 18 07:03:08 user nova-compute[74587]:   </guest>
Oct 18 07:03:08 user nova-compute[74587]: </capabilities>
Oct 18 07:03:08 user nova-compute[74587]: 
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 18 07:03:08 user nova-compute[74587]: <domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:   <path>/usr/bin/qemu-system-i386</path>
Oct 18 07:03:08 user nova-compute[74587]:   <domain>kvm</domain>
Oct 18 07:03:08 user nova-compute[74587]:   <machine>pc-i440fx-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:   <arch>i686</arch>
Oct 18 07:03:08 user nova-compute[74587]:   <vcpu max='255'/>
Oct 18 07:03:08 user nova-compute[74587]:   <iothreads supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:   <os supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='firmware'/>
Oct 18 07:03:08 user nova-compute[74587]:     <loader supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>rom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pflash</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='readonly'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>yes</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='secure'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </loader>
Oct 18 07:03:08 user nova-compute[74587]:   </os>
Oct 18 07:03:08 user nova-compute[74587]:   <cpu>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-passthrough' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='hostPassthroughMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='maximum' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='maximumMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-model' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <vendor>Intel</vendor>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ss'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='vmx'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pcid'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='hypervisor'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arat'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='umip'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='md-clear'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibpb'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibrs'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='erms'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='lm'/>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='custom' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>qemu64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>qemu32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>phenom</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>n270</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>kvm64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>coreduo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>core2duo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>athlon</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Westmere-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Westmere</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Snowridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Penryn</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G5</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G4</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G1</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Nehalem-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Nehalem</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Rome</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Milan</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Dhyana</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cooperlake</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Conroe</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>486</model>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:   </cpu>
Oct 18 07:03:08 user nova-compute[74587]:   <memoryBacking supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='sourceType'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>file</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>anonymous</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>memfd</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:   </memoryBacking>
Oct 18 07:03:08 user nova-compute[74587]:   <devices>
Oct 18 07:03:08 user nova-compute[74587]:     <disk supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='diskDevice'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>disk</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cdrom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>floppy</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>lun</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='bus'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ide</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>fdc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sata</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </disk>
Oct 18 07:03:08 user nova-compute[74587]:     <graphics supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sdl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vnc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>spice</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egl-headless</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </graphics>
Oct 18 07:03:08 user nova-compute[74587]:     <video supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='modelType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cirrus</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vmvga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>qxl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>none</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>bochs</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ramfb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </video>
Oct 18 07:03:08 user nova-compute[74587]:     <hostdev supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='mode'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>subsystem</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='startupPolicy'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>default</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>mandatory</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>requisite</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>optional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='subsysType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pci</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='capsType'/>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='pciBackend'/>
Oct 18 07:03:08 user nova-compute[74587]:     </hostdev>
Oct 18 07:03:08 user nova-compute[74587]:     <rng supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>random</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egd</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>builtin</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </rng>
Oct 18 07:03:08 user nova-compute[74587]:     <filesystem supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='driverType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>path</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>handle</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtiofs</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </filesystem>
Oct 18 07:03:08 user nova-compute[74587]:     <tpm supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-tis</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-crb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>passthrough</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>emulator</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </tpm>
Oct 18 07:03:08 user nova-compute[74587]:   </devices>
Oct 18 07:03:08 user nova-compute[74587]:   <features>
Oct 18 07:03:08 user nova-compute[74587]:     <gic supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     <vmcoreinfo supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <genid supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backingStoreInput supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backup supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <sev supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:   </features>
Oct 18 07:03:08 user nova-compute[74587]: </domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:  {{(pid=74587) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 18 07:03:08 user nova-compute[74587]: <domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:   <path>/usr/bin/qemu-system-i386</path>
Oct 18 07:03:08 user nova-compute[74587]:   <domain>kvm</domain>
Oct 18 07:03:08 user nova-compute[74587]:   <machine>pc-q35-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:   <arch>i686</arch>
Oct 18 07:03:08 user nova-compute[74587]:   <vcpu max='288'/>
Oct 18 07:03:08 user nova-compute[74587]:   <iothreads supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:   <os supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='firmware'/>
Oct 18 07:03:08 user nova-compute[74587]:     <loader supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>rom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pflash</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='readonly'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>yes</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='secure'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </loader>
Oct 18 07:03:08 user nova-compute[74587]:   </os>
Oct 18 07:03:08 user nova-compute[74587]:   <cpu>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-passthrough' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='hostPassthroughMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='maximum' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='maximumMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-model' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <vendor>Intel</vendor>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ss'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='vmx'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pcid'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='hypervisor'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arat'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='umip'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='md-clear'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibpb'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibrs'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='erms'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='lm'/>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='custom' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>qemu64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>qemu32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>phenom</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>n270</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>kvm64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>coreduo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>core2duo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>athlon</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Westmere-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Westmere</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Snowridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Penryn</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G5</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G4</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G1</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Nehalem-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Nehalem</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Rome</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Milan</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Dhyana</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cooperlake</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Conroe</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>486</model>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:   </cpu>
Oct 18 07:03:08 user nova-compute[74587]:   <memoryBacking supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='sourceType'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>file</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>anonymous</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>memfd</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:   </memoryBacking>
Oct 18 07:03:08 user nova-compute[74587]:   <devices>
Oct 18 07:03:08 user nova-compute[74587]:     <disk supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='diskDevice'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>disk</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cdrom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>floppy</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>lun</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='bus'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>fdc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sata</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </disk>
Oct 18 07:03:08 user nova-compute[74587]:     <graphics supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sdl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vnc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>spice</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egl-headless</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </graphics>
Oct 18 07:03:08 user nova-compute[74587]:     <video supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='modelType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cirrus</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vmvga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>qxl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>none</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>bochs</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ramfb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </video>
Oct 18 07:03:08 user nova-compute[74587]:     <hostdev supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='mode'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>subsystem</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='startupPolicy'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>default</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>mandatory</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>requisite</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>optional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='subsysType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pci</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='capsType'/>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='pciBackend'/>
Oct 18 07:03:08 user nova-compute[74587]:     </hostdev>
Oct 18 07:03:08 user nova-compute[74587]:     <rng supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>random</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egd</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>builtin</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </rng>
Oct 18 07:03:08 user nova-compute[74587]:     <filesystem supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='driverType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>path</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>handle</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtiofs</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </filesystem>
Oct 18 07:03:08 user nova-compute[74587]:     <tpm supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-tis</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-crb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>passthrough</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>emulator</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </tpm>
Oct 18 07:03:08 user nova-compute[74587]:   </devices>
Oct 18 07:03:08 user nova-compute[74587]:   <features>
Oct 18 07:03:08 user nova-compute[74587]:     <gic supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     <vmcoreinfo supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <genid supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backingStoreInput supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backup supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <sev supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:   </features>
Oct 18 07:03:08 user nova-compute[74587]: </domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:  {{(pid=74587) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 18 07:03:08 user nova-compute[74587]: <domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:   <path>/usr/bin/qemu-system-i386</path>
Oct 18 07:03:08 user nova-compute[74587]:   <domain>kvm</domain>
Oct 18 07:03:08 user nova-compute[74587]:   <machine>pc-i440fx-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:   <arch>i686</arch>
Oct 18 07:03:08 user nova-compute[74587]:   <vcpu max='255'/>
Oct 18 07:03:08 user nova-compute[74587]:   <iothreads supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:   <os supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='firmware'/>
Oct 18 07:03:08 user nova-compute[74587]:     <loader supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>rom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pflash</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='readonly'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>yes</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='secure'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </loader>
Oct 18 07:03:08 user nova-compute[74587]:   </os>
Oct 18 07:03:08 user nova-compute[74587]:   <cpu>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-passthrough' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='hostPassthroughMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='maximum' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='maximumMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-model' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <vendor>Intel</vendor>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ss'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='vmx'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pcid'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='hypervisor'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arat'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='umip'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='md-clear'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibpb'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibrs'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='erms'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='lm'/>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='custom' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>qemu64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>qemu32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>phenom</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>n270</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>kvm64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>coreduo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>core2duo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>athlon</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Westmere-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Westmere</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Snowridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Penryn</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G5</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G4</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G1</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Nehalem-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Nehalem</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Rome</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Milan</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Dhyana</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cooperlake</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Conroe</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>486</model>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:   </cpu>
Oct 18 07:03:08 user nova-compute[74587]:   <memoryBacking supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='sourceType'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>file</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>anonymous</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>memfd</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:   </memoryBacking>
Oct 18 07:03:08 user nova-compute[74587]:   <devices>
Oct 18 07:03:08 user nova-compute[74587]:     <disk supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='diskDevice'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>disk</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cdrom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>floppy</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>lun</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='bus'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ide</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>fdc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sata</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </disk>
Oct 18 07:03:08 user nova-compute[74587]:     <graphics supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sdl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vnc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>spice</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egl-headless</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </graphics>
Oct 18 07:03:08 user nova-compute[74587]:     <video supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='modelType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cirrus</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vmvga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>qxl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>none</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>bochs</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ramfb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </video>
Oct 18 07:03:08 user nova-compute[74587]:     <hostdev supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='mode'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>subsystem</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='startupPolicy'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>default</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>mandatory</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>requisite</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>optional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='subsysType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pci</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='capsType'/>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='pciBackend'/>
Oct 18 07:03:08 user nova-compute[74587]:     </hostdev>
Oct 18 07:03:08 user nova-compute[74587]:     <rng supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>random</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egd</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>builtin</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </rng>
Oct 18 07:03:08 user nova-compute[74587]:     <filesystem supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='driverType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>path</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>handle</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtiofs</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </filesystem>
Oct 18 07:03:08 user nova-compute[74587]:     <tpm supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-tis</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-crb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>passthrough</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>emulator</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </tpm>
Oct 18 07:03:08 user nova-compute[74587]:   </devices>
Oct 18 07:03:08 user nova-compute[74587]:   <features>
Oct 18 07:03:08 user nova-compute[74587]:     <gic supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     <vmcoreinfo supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <genid supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backingStoreInput supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backup supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <sev supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:   </features>
Oct 18 07:03:08 user nova-compute[74587]: </domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:  {{(pid=74587) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 18 07:03:08 user nova-compute[74587]: <domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:   <path>/usr/bin/qemu-system-i386</path>
Oct 18 07:03:08 user nova-compute[74587]:   <domain>kvm</domain>
Oct 18 07:03:08 user nova-compute[74587]:   <machine>pc-q35-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:   <arch>i686</arch>
Oct 18 07:03:08 user nova-compute[74587]:   <vcpu max='288'/>
Oct 18 07:03:08 user nova-compute[74587]:   <iothreads supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:   <os supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='firmware'/>
Oct 18 07:03:08 user nova-compute[74587]:     <loader supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>rom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pflash</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='readonly'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>yes</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='secure'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </loader>
Oct 18 07:03:08 user nova-compute[74587]:   </os>
Oct 18 07:03:08 user nova-compute[74587]:   <cpu>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-passthrough' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='hostPassthroughMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='maximum' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='maximumMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-model' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <vendor>Intel</vendor>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ss'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='vmx'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pcid'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='hypervisor'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arat'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='umip'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='md-clear'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibpb'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibrs'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='erms'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='lm'/>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='custom' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>qemu64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>qemu32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>phenom</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>n270</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>kvm64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>coreduo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>core2duo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>athlon</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Westmere-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Westmere</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Snowridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Penryn</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G5</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G4</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G1</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Nehalem-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Nehalem</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Rome</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Milan</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Dhyana</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cooperlake</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Conroe</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>486</model>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:   </cpu>
Oct 18 07:03:08 user nova-compute[74587]:   <memoryBacking supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='sourceType'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>file</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>anonymous</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>memfd</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:   </memoryBacking>
Oct 18 07:03:08 user nova-compute[74587]:   <devices>
Oct 18 07:03:08 user nova-compute[74587]:     <disk supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='diskDevice'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>disk</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cdrom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>floppy</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>lun</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='bus'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>fdc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sata</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </disk>
Oct 18 07:03:08 user nova-compute[74587]:     <graphics supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sdl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vnc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>spice</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egl-headless</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </graphics>
Oct 18 07:03:08 user nova-compute[74587]:     <video supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='modelType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cirrus</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vmvga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>qxl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>none</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>bochs</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ramfb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </video>
Oct 18 07:03:08 user nova-compute[74587]:     <hostdev supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='mode'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>subsystem</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='startupPolicy'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>default</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>mandatory</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>requisite</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>optional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='subsysType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pci</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='capsType'/>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='pciBackend'/>
Oct 18 07:03:08 user nova-compute[74587]:     </hostdev>
Oct 18 07:03:08 user nova-compute[74587]:     <rng supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>random</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egd</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>builtin</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </rng>
Oct 18 07:03:08 user nova-compute[74587]:     <filesystem supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='driverType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>path</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>handle</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtiofs</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </filesystem>
Oct 18 07:03:08 user nova-compute[74587]:     <tpm supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-tis</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-crb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>passthrough</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>emulator</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </tpm>
Oct 18 07:03:08 user nova-compute[74587]:   </devices>
Oct 18 07:03:08 user nova-compute[74587]:   <features>
Oct 18 07:03:08 user nova-compute[74587]:     <gic supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     <vmcoreinfo supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <genid supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backingStoreInput supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backup supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <sev supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:   </features>
Oct 18 07:03:08 user nova-compute[74587]: </domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:  {{(pid=74587) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 18 07:03:08 user nova-compute[74587]: <domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 18 07:03:08 user nova-compute[74587]:   <domain>kvm</domain>
Oct 18 07:03:08 user nova-compute[74587]:   <machine>pc-i440fx-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:   <arch>x86_64</arch>
Oct 18 07:03:08 user nova-compute[74587]:   <vcpu max='255'/>
Oct 18 07:03:08 user nova-compute[74587]:   <iothreads supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:   <os supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='firmware'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>efi</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:     <loader supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>rom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pflash</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='readonly'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>yes</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='secure'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </loader>
Oct 18 07:03:08 user nova-compute[74587]:   </os>
Oct 18 07:03:08 user nova-compute[74587]:   <cpu>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-passthrough' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='hostPassthroughMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='maximum' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='maximumMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-model' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <vendor>Intel</vendor>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ss'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='vmx'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pcid'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='hypervisor'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arat'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='umip'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='md-clear'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='invtsc'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibpb'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibrs'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='rsba'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pschange-mc-no'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='erms'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='custom' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>qemu64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>qemu32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>phenom</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>n270</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>coreduo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>core2duo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>athlon</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Westmere-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Westmere</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Snowridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Penryn</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G5</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G4</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Opteron_G1</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Nehalem</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Rome</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Milan</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Dhyana</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cooperlake</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Conroe</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>486</model>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:   </cpu>
Oct 18 07:03:08 user nova-compute[74587]:   <memoryBacking supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='sourceType'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>file</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>anonymous</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>memfd</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:   </memoryBacking>
Oct 18 07:03:08 user nova-compute[74587]:   <devices>
Oct 18 07:03:08 user nova-compute[74587]:     <disk supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='diskDevice'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>disk</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cdrom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>floppy</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>lun</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='bus'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ide</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>fdc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sata</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </disk>
Oct 18 07:03:08 user nova-compute[74587]:     <graphics supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sdl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vnc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>spice</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egl-headless</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </graphics>
Oct 18 07:03:08 user nova-compute[74587]:     <video supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='modelType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cirrus</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vmvga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>qxl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>none</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>bochs</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ramfb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </video>
Oct 18 07:03:08 user nova-compute[74587]:     <hostdev supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='mode'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>subsystem</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='startupPolicy'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>default</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>mandatory</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>requisite</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>optional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='subsysType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pci</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='capsType'/>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='pciBackend'/>
Oct 18 07:03:08 user nova-compute[74587]:     </hostdev>
Oct 18 07:03:08 user nova-compute[74587]:     <rng supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>random</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egd</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>builtin</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </rng>
Oct 18 07:03:08 user nova-compute[74587]:     <filesystem supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='driverType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>path</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>handle</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtiofs</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </filesystem>
Oct 18 07:03:08 user nova-compute[74587]:     <tpm supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-tis</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-crb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>passthrough</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>emulator</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </tpm>
Oct 18 07:03:08 user nova-compute[74587]:   </devices>
Oct 18 07:03:08 user nova-compute[74587]:   <features>
Oct 18 07:03:08 user nova-compute[74587]:     <gic supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     <vmcoreinfo supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <genid supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backingStoreInput supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backup supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <sev supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:   </features>
Oct 18 07:03:08 user nova-compute[74587]: </domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:  {{(pid=74587) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 18 07:03:08 user nova-compute[74587]: <domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 18 07:03:08 user nova-compute[74587]:   <domain>kvm</domain>
Oct 18 07:03:08 user nova-compute[74587]:   <machine>pc-q35-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:   <arch>x86_64</arch>
Oct 18 07:03:08 user nova-compute[74587]:   <vcpu max='288'/>
Oct 18 07:03:08 user nova-compute[74587]:   <iothreads supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:   <os supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='firmware'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>efi</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:     <loader supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>rom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pflash</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='readonly'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>yes</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='secure'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>yes</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </loader>
Oct 18 07:03:08 user nova-compute[74587]:   </os>
Oct 18 07:03:08 user nova-compute[74587]:   <cpu>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-passthrough' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='hostPassthroughMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='maximum' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='maximumMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-model' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <vendor>Intel</vendor>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ss'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='vmx'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pcid'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='hypervisor'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arat'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='umip'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='md-clear'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='invtsc'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibpb'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibrs'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='rsba'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pschange-mc-no'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='erms'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='custom' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>qemu64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>qemu32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>phenom</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>n270</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>coreduo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>core2duo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>athlon</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Westmere-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Westmere</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Snowridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Penryn</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G5</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G4</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Opteron_G1</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Nehalem</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Rome</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Milan</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Dhyana</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cooperlake</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Conroe</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>486</model>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:   </cpu>
Oct 18 07:03:08 user nova-compute[74587]:   <memoryBacking supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='sourceType'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>file</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>anonymous</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>memfd</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:   </memoryBacking>
Oct 18 07:03:08 user nova-compute[74587]:   <devices>
Oct 18 07:03:08 user nova-compute[74587]:     <disk supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='diskDevice'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>disk</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cdrom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>floppy</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>lun</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='bus'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>fdc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sata</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </disk>
Oct 18 07:03:08 user nova-compute[74587]:     <graphics supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sdl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vnc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>spice</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egl-headless</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </graphics>
Oct 18 07:03:08 user nova-compute[74587]:     <video supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='modelType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cirrus</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vmvga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>qxl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>none</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>bochs</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ramfb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </video>
Oct 18 07:03:08 user nova-compute[74587]:     <hostdev supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='mode'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>subsystem</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='startupPolicy'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>default</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>mandatory</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>requisite</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>optional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='subsysType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pci</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='capsType'/>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='pciBackend'/>
Oct 18 07:03:08 user nova-compute[74587]:     </hostdev>
Oct 18 07:03:08 user nova-compute[74587]:     <rng supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>random</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egd</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>builtin</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </rng>
Oct 18 07:03:08 user nova-compute[74587]:     <filesystem supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='driverType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>path</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>handle</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtiofs</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </filesystem>
Oct 18 07:03:08 user nova-compute[74587]:     <tpm supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-tis</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-crb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>passthrough</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>emulator</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </tpm>
Oct 18 07:03:08 user nova-compute[74587]:   </devices>
Oct 18 07:03:08 user nova-compute[74587]:   <features>
Oct 18 07:03:08 user nova-compute[74587]:     <gic supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     <vmcoreinfo supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <genid supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backingStoreInput supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backup supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <sev supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:   </features>
Oct 18 07:03:08 user nova-compute[74587]: </domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:  {{(pid=74587) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 18 07:03:08 user nova-compute[74587]: <domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 18 07:03:08 user nova-compute[74587]:   <domain>kvm</domain>
Oct 18 07:03:08 user nova-compute[74587]:   <machine>pc-i440fx-6.2</machine>
Oct 18 07:03:08 user nova-compute[74587]:   <arch>x86_64</arch>
Oct 18 07:03:08 user nova-compute[74587]:   <vcpu max='255'/>
Oct 18 07:03:08 user nova-compute[74587]:   <iothreads supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:   <os supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='firmware'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>efi</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:     <loader supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>rom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pflash</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='readonly'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>yes</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='secure'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </loader>
Oct 18 07:03:08 user nova-compute[74587]:   </os>
Oct 18 07:03:08 user nova-compute[74587]:   <cpu>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-passthrough' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='hostPassthroughMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='maximum' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='maximumMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-model' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <vendor>Intel</vendor>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ss'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='vmx'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pcid'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='hypervisor'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arat'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='umip'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='md-clear'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='invtsc'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibpb'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibrs'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='rsba'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pschange-mc-no'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='erms'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='custom' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>qemu64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>qemu32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>phenom</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>n270</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>coreduo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>core2duo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>athlon</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Westmere-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Westmere</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Snowridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Penryn</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G5</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G4</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Opteron_G1</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Nehalem</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Rome</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Milan</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Dhyana</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cooperlake</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Conroe</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>486</model>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:   </cpu>
Oct 18 07:03:08 user nova-compute[74587]:   <memoryBacking supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='sourceType'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>file</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>anonymous</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>memfd</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:   </memoryBacking>
Oct 18 07:03:08 user nova-compute[74587]:   <devices>
Oct 18 07:03:08 user nova-compute[74587]:     <disk supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='diskDevice'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>disk</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cdrom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>floppy</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>lun</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='bus'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ide</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>fdc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sata</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </disk>
Oct 18 07:03:08 user nova-compute[74587]:     <graphics supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sdl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vnc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>spice</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egl-headless</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </graphics>
Oct 18 07:03:08 user nova-compute[74587]:     <video supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='modelType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cirrus</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vmvga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>qxl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>none</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>bochs</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ramfb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </video>
Oct 18 07:03:08 user nova-compute[74587]:     <hostdev supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='mode'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>subsystem</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='startupPolicy'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>default</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>mandatory</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>requisite</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>optional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='subsysType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pci</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='capsType'/>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='pciBackend'/>
Oct 18 07:03:08 user nova-compute[74587]:     </hostdev>
Oct 18 07:03:08 user nova-compute[74587]:     <rng supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>random</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egd</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>builtin</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </rng>
Oct 18 07:03:08 user nova-compute[74587]:     <filesystem supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='driverType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>path</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>handle</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtiofs</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </filesystem>
Oct 18 07:03:08 user nova-compute[74587]:     <tpm supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-tis</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-crb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>passthrough</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>emulator</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </tpm>
Oct 18 07:03:08 user nova-compute[74587]:   </devices>
Oct 18 07:03:08 user nova-compute[74587]:   <features>
Oct 18 07:03:08 user nova-compute[74587]:     <gic supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     <vmcoreinfo supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <genid supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backingStoreInput supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backup supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <sev supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:   </features>
Oct 18 07:03:08 user nova-compute[74587]: </domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:  {{(pid=74587) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 18 07:03:08 user nova-compute[74587]: <domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 18 07:03:08 user nova-compute[74587]:   <domain>kvm</domain>
Oct 18 07:03:08 user nova-compute[74587]:   <machine>pc-q35-jammy</machine>
Oct 18 07:03:08 user nova-compute[74587]:   <arch>x86_64</arch>
Oct 18 07:03:08 user nova-compute[74587]:   <vcpu max='288'/>
Oct 18 07:03:08 user nova-compute[74587]:   <iothreads supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:   <os supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='firmware'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>efi</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:     <loader supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>rom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pflash</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='readonly'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>yes</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='secure'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>yes</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>no</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </loader>
Oct 18 07:03:08 user nova-compute[74587]:   </os>
Oct 18 07:03:08 user nova-compute[74587]:   <cpu>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-passthrough' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='hostPassthroughMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='maximum' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='maximumMigratable'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>on</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>off</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='host-model' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <vendor>Intel</vendor>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ss'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='vmx'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pcid'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='hypervisor'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arat'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='umip'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='md-clear'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='invtsc'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibpb'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='ibrs'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-stibp'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='rsba'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='require' name='pschange-mc-no'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='erms'/>
Oct 18 07:03:08 user nova-compute[74587]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:     <mode name='custom' supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>qemu64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>qemu32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>phenom</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>pentium</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>n270</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm64</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>kvm32</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>coreduo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>core2duo</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>athlon</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Westmere-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Westmere</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Snowridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Skylake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>SandyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Penryn</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G5</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G4</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G3</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Opteron_G2</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Opteron_G1</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Nehalem</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>IvyBridge</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Icelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Haswell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Rome</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-Milan</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>EPYC</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Dhyana</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cooperlake</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>Conroe</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='no'>Broadwell</model>
Oct 18 07:03:08 user nova-compute[74587]:       <model usable='yes'>486</model>
Oct 18 07:03:08 user nova-compute[74587]:     </mode>
Oct 18 07:03:08 user nova-compute[74587]:   </cpu>
Oct 18 07:03:08 user nova-compute[74587]:   <memoryBacking supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:     <enum name='sourceType'>
Oct 18 07:03:08 user nova-compute[74587]:       <value>file</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>anonymous</value>
Oct 18 07:03:08 user nova-compute[74587]:       <value>memfd</value>
Oct 18 07:03:08 user nova-compute[74587]:     </enum>
Oct 18 07:03:08 user nova-compute[74587]:   </memoryBacking>
Oct 18 07:03:08 user nova-compute[74587]:   <devices>
Oct 18 07:03:08 user nova-compute[74587]:     <disk supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='diskDevice'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>disk</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cdrom</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>floppy</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>lun</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='bus'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>fdc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sata</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </disk>
Oct 18 07:03:08 user nova-compute[74587]:     <graphics supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='type'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>sdl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vnc</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>spice</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egl-headless</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </graphics>
Oct 18 07:03:08 user nova-compute[74587]:     <video supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='modelType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>cirrus</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>vmvga</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>qxl</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>none</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>bochs</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>ramfb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </video>
Oct 18 07:03:08 user nova-compute[74587]:     <hostdev supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='mode'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>subsystem</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='startupPolicy'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>default</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>mandatory</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>requisite</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>optional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='subsysType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>usb</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>pci</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>scsi</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='capsType'/>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='pciBackend'/>
Oct 18 07:03:08 user nova-compute[74587]:     </hostdev>
Oct 18 07:03:08 user nova-compute[74587]:     <rng supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtio-non-transitional</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>random</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>egd</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>builtin</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </rng>
Oct 18 07:03:08 user nova-compute[74587]:     <filesystem supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='driverType'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>path</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>handle</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>virtiofs</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </filesystem>
Oct 18 07:03:08 user nova-compute[74587]:     <tpm supported='yes'>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='model'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-tis</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>tpm-crb</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:       <enum name='backendModel'>
Oct 18 07:03:08 user nova-compute[74587]:         <value>passthrough</value>
Oct 18 07:03:08 user nova-compute[74587]:         <value>emulator</value>
Oct 18 07:03:08 user nova-compute[74587]:       </enum>
Oct 18 07:03:08 user nova-compute[74587]:     </tpm>
Oct 18 07:03:08 user nova-compute[74587]:   </devices>
Oct 18 07:03:08 user nova-compute[74587]:   <features>
Oct 18 07:03:08 user nova-compute[74587]:     <gic supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:     <vmcoreinfo supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <genid supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backingStoreInput supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <backup supported='yes'/>
Oct 18 07:03:08 user nova-compute[74587]:     <sev supported='no'/>
Oct 18 07:03:08 user nova-compute[74587]:   </features>
Oct 18 07:03:08 user nova-compute[74587]: </domainCapabilities>
Oct 18 07:03:08 user nova-compute[74587]:  {{(pid=74587) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74587) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74587) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Checking secure boot support for host arch (x86_64) {{(pid=74587) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Checking secure boot support for host arch (x86_64) {{(pid=74587) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Checking secure boot support for host arch (x86_64) {{(pid=74587) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 18 07:03:08 user nova-compute[74587]: INFO nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Secure Boot support detected
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] cpu compare xml: <cpu match="exact">
Oct 18 07:03:08 user nova-compute[74587]:   <model>Nehalem</model>
Oct 18 07:03:08 user nova-compute[74587]: </cpu>
Oct 18 07:03:08 user nova-compute[74587]:  {{(pid=74587) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 18 07:03:08 user nova-compute[74587]: INFO nova.virt.node [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Generated node identity 397368dc-ec08-427c-87a9-228e852f6a40
Oct 18 07:03:08 user nova-compute[74587]: INFO nova.virt.node [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Wrote node identity 397368dc-ec08-427c-87a9-228e852f6a40 to /opt/stack/data/nova/compute_id
Oct 18 07:03:08 user nova-compute[74587]: WARNING nova.compute.manager [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Compute nodes ['397368dc-ec08-427c-87a9-228e852f6a40'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 18 07:03:08 user nova-compute[74587]: INFO nova.compute.manager [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 18 07:03:08 user nova-compute[74587]: WARNING nova.compute.manager [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 18 07:03:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:03:08 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:03:08 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:03:08 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Hypervisor/Node resource view: name=user free_ram=10938MB free_disk=26.240673065185547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:03:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:03:08 user nova-compute[74587]: WARNING nova.compute.resource_tracker [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] No compute node record for user:397368dc-ec08-427c-87a9-228e852f6a40: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 397368dc-ec08-427c-87a9-228e852f6a40 could not be found.
Oct 18 07:03:08 user nova-compute[74587]: INFO nova.compute.resource_tracker [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Compute node record created for user:user with uuid: 397368dc-ec08-427c-87a9-228e852f6a40
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:03:09 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] [req-f022bae8-3b67-4be0-90f1-9bbf225d9834] Created resource provider record via placement API for resource provider with UUID 397368dc-ec08-427c-87a9-228e852f6a40 and name user.
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74587) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 18 07:03:09 user nova-compute[74587]: INFO nova.virt.libvirt.host [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] kernel doesn't support AMD SEV
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Libvirt baseline CPU <cpu>
Oct 18 07:03:09 user nova-compute[74587]:   <arch>x86_64</arch>
Oct 18 07:03:09 user nova-compute[74587]:   <model>Nehalem</model>
Oct 18 07:03:09 user nova-compute[74587]:   <vendor>Intel</vendor>
Oct 18 07:03:09 user nova-compute[74587]:   <topology sockets="6" cores="1" threads="1"/>
Oct 18 07:03:09 user nova-compute[74587]: </cpu>
Oct 18 07:03:09 user nova-compute[74587]:  {{(pid=74587) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Updated inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Updating resource provider 397368dc-ec08-427c-87a9-228e852f6a40 generation from 0 to 1 during operation: update_inventory {{(pid=74587) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Updating resource provider 397368dc-ec08-427c-87a9-228e852f6a40 generation from 1 to 2 during operation: update_traits {{(pid=74587) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.service [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Creating RPC server for service compute {{(pid=74587) start /opt/stack/nova/nova/service.py:182}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.service [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] Join ServiceGroup membership for this service compute {{(pid=74587) start /opt/stack/nova/nova/service.py:199}}
Oct 18 07:03:09 user nova-compute[74587]: DEBUG nova.servicegroup.drivers.db [None req-d1d20472-c303-4284-a86a-cd4825192bba None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74587) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 18 07:03:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:03:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:04:00 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:04:00 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=10380MB free_disk=26.144393920898438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:05:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:05:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:05:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:05:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:05:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:05:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:05:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:05:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:05:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:05:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=10325MB free_disk=26.208614349365234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:05:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.096s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:05:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:05:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:05:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:06:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:06:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:06:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:06:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:06:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:06:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:06:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:06:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:06:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:06:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:06:03 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:06:03 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:06:03 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=10332MB free_disk=25.962039947509766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:06:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:06:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:07:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:07:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:07:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:07:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:07:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=9567MB free_disk=25.98171615600586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:05 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:06 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:07:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:07:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:07:08 user nova-compute[74587]: INFO nova.compute.claims [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Claim successful on node user
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.network.neutron [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:07:09 user nova-compute[74587]: INFO nova.compute.claims [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Claim successful on node user
Oct 18 07:07:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:07:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Creating image(s)
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG nova.network.neutron [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:07:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:07:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG nova.policy [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96efd41052434514aea7fe47a5eb36f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dbea9d8d34471b74b5c002f5905f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:07:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Creating image(s)
Oct 18 07:07:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76.part --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG nova.policy [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96efd41052434514aea7fe47a5eb36f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dbea9d8d34471b74b5c002f5905f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:07:11 user nova-compute[74587]: INFO nova.compute.claims [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Claim successful on node user
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76.part --force-share --output=json" returned: 0 in 0.224s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG nova.virt.images [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] 9442f4c2-6355-454c-90aa-9dccf102d343 was qcow2, converting to raw {{(pid=74587) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76.part /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76.converted {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76.part /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76.converted" returned: 0 in 0.263s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76.converted --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.986s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:11 user nova-compute[74587]: INFO oslo.privsep.daemon [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4qupg_3i/privsep.sock']
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.260s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:11 user sudo[83811]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4qupg_3i/privsep.sock
Oct 18 07:07:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:07:11 user sudo[83811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 18 07:07:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:07:12 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:07:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:07:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:07:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:07:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:07:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Creating image(s)
Oct 18 07:07:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "/opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "/opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "/opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:12 user nova-compute[74587]: DEBUG nova.policy [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2ca09ce37384d25931eb9a658384255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c002a125aec54fa388965a9f83cc1624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:07:13 user sudo[83811]: pam_unix(sudo:session): session closed for user root
Oct 18 07:07:13 user nova-compute[74587]: INFO oslo.privsep.daemon [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Spawned new privsep daemon via rootwrap
Oct 18 07:07:13 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 18 07:07:13 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 18 07:07:13 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 18 07:07:13 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83814
Oct 18 07:07:13 user nova-compute[74587]: WARNING oslo_privsep.priv_context [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] privsep daemon already running
Oct 18 07:07:13 user nova-compute[74587]: WARNING oslo_privsep.priv_context [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] privsep daemon already running
Oct 18 07:07:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:13 user nova-compute[74587]: DEBUG nova.network.neutron [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Successfully created port: 338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.284s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.215s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.190s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk 1073741824" returned: 0 in 0.112s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.289s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG nova.network.neutron [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Successfully created port: da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.201s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.197s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk 1073741824" returned: 0 in 0.050s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.591s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Cannot resize image /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Ensure instance console log exists: /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.208s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Successfully created port: 21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.205s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk 1073741824" returned: 0 in 0.058s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Cannot resize image /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Ensure instance console log exists: /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Cannot resize image /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Ensure instance console log exists: /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Successfully updated port: 338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:07:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquired lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:07:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:07:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Successfully updated port: da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-12b98b35-b97e-47d3-a53c-d2b008abbb55 req-015525dc-b2f3-4145-9272-3c3a71069278 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-changed-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-12b98b35-b97e-47d3-a53c-d2b008abbb55 req-015525dc-b2f3-4145-9272-3c3a71069278 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Refreshing instance network info cache due to event network-changed-338116e1-ec57-4c95-987e-d6d72a2b50b3. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-12b98b35-b97e-47d3-a53c-d2b008abbb55 req-015525dc-b2f3-4145-9272-3c3a71069278 service nova] Acquiring lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquired lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Successfully updated port: 21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquired lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-d5efb863-e21c-44fc-94e5-feb83df1a523 req-368ff7ab-88d3-4cb3-9e24-61758553834f service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-changed-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-d5efb863-e21c-44fc-94e5-feb83df1a523 req-368ff7ab-88d3-4cb3-9e24-61758553834f service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Refreshing instance network info cache due to event network-changed-21d53194-906d-4d43-8a10-dc04180809ef. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:07:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d5efb863-e21c-44fc-94e5-feb83df1a523 req-368ff7ab-88d3-4cb3-9e24-61758553834f service nova] Acquiring lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.neutron [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updating instance_info_cache with network_info: [{"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Releasing lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Instance network_info: |[{"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-12b98b35-b97e-47d3-a53c-d2b008abbb55 req-015525dc-b2f3-4145-9272-3c3a71069278 service nova] Acquired lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.neutron [req-12b98b35-b97e-47d3-a53c-d2b008abbb55 req-015525dc-b2f3-4145-9272-3c3a71069278 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Refreshing network info cache for port 338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Start _get_guest_xml network_info=[{"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:07:18 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:18 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1612933739',display_name='tempest-ServerRescueNegativeTestJSON-server-1612933739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1612933739',id=1,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-ungvr3bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:10Z,user_data=None,user_id='96efd41052434514aea7fe47a5eb36f7',uuid=0d568195-c89b-47e8-9992-bfc3a6c8e929,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:50:bd,bridge_name='br-int',has_traffic_filtering=True,id=338116e1-ec57-4c95-987e-d6d72a2b50b3,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338116e1-ec') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.objects.instance [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:07:18 user nova-compute[74587]:   <uuid>0d568195-c89b-47e8-9992-bfc3a6c8e929</uuid>
Oct 18 07:07:18 user nova-compute[74587]:   <name>instance-00000001</name>
Oct 18 07:07:18 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:07:18 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:07:18 user nova-compute[74587]:   <metadata>
Oct 18 07:07:18 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:07:18 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1612933739</nova:name>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:07:18</nova:creationTime>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:07:18 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:07:18 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:owner>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:user uuid="96efd41052434514aea7fe47a5eb36f7">tempest-ServerRescueNegativeTestJSON-1222499333-project-member</nova:user>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:project uuid="1b1dbea9d8d34471b74b5c002f5905f0">tempest-ServerRescueNegativeTestJSON-1222499333</nova:project>
Oct 18 07:07:18 user nova-compute[74587]:       </nova:owner>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:ports>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:port uuid="338116e1-ec57-4c95-987e-d6d72a2b50b3">
Oct 18 07:07:18 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 07:07:18 user nova-compute[74587]:         </nova:port>
Oct 18 07:07:18 user nova-compute[74587]:       </nova:ports>
Oct 18 07:07:18 user nova-compute[74587]:     </nova:instance>
Oct 18 07:07:18 user nova-compute[74587]:   </metadata>
Oct 18 07:07:18 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:07:18 user nova-compute[74587]:     <system>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="serial">0d568195-c89b-47e8-9992-bfc3a6c8e929</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="uuid">0d568195-c89b-47e8-9992-bfc3a6c8e929</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:07:18 user nova-compute[74587]:     </system>
Oct 18 07:07:18 user nova-compute[74587]:   </sysinfo>
Oct 18 07:07:18 user nova-compute[74587]:   <os>
Oct 18 07:07:18 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:07:18 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:07:18 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:07:18 user nova-compute[74587]:   </os>
Oct 18 07:07:18 user nova-compute[74587]:   <features>
Oct 18 07:07:18 user nova-compute[74587]:     <acpi/>
Oct 18 07:07:18 user nova-compute[74587]:     <apic/>
Oct 18 07:07:18 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:07:18 user nova-compute[74587]:   </features>
Oct 18 07:07:18 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:07:18 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:07:18 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:07:18 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:07:18 user nova-compute[74587]:   </clock>
Oct 18 07:07:18 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:07:18 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:07:18 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:07:18 user nova-compute[74587]:   </cpu>
Oct 18 07:07:18 user nova-compute[74587]:   <devices>
Oct 18 07:07:18 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:07:18 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:07:18 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk"/>
Oct 18 07:07:18 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:07:18 user nova-compute[74587]:     </disk>
Oct 18 07:07:18 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:07:18 user nova-compute[74587]:       <mac address="fa:16:3e:5f:50:bd"/>
Oct 18 07:07:18 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:18 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:07:18 user nova-compute[74587]:       <target dev="tap338116e1-ec"/>
Oct 18 07:07:18 user nova-compute[74587]:     </interface>
Oct 18 07:07:18 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:07:18 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/console.log" append="off"/>
Oct 18 07:07:18 user nova-compute[74587]:     </serial>
Oct 18 07:07:18 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:07:18 user nova-compute[74587]:     <video>
Oct 18 07:07:18 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:18 user nova-compute[74587]:     </video>
Oct 18 07:07:18 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:07:18 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:07:18 user nova-compute[74587]:     </rng>
Oct 18 07:07:18 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:07:18 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:07:18 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:07:18 user nova-compute[74587]:     </memballoon>
Oct 18 07:07:18 user nova-compute[74587]:   </devices>
Oct 18 07:07:18 user nova-compute[74587]: </domain>
Oct 18 07:07:18 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1612933739',display_name='tempest-ServerRescueNegativeTestJSON-server-1612933739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1612933739',id=1,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-ungvr3bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:10Z,user_data=None,user_id='96efd41052434514aea7fe47a5eb36f7',uuid=0d568195-c89b-47e8-9992-bfc3a6c8e929,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:50:bd,bridge_name='br-int',has_traffic_filtering=True,id=338116e1-ec57-4c95-987e-d6d72a2b50b3,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338116e1-ec') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG os_vif [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:50:bd,bridge_name='br-int',has_traffic_filtering=True,id=338116e1-ec57-4c95-987e-d6d72a2b50b3,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338116e1-ec') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updating instance_info_cache with network_info: [{"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Created schema index Interface.name {{(pid=74587) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Created schema index Port.name {{(pid=74587) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Created schema index Bridge.name {{(pid=74587) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [POLLOUT] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Releasing lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Instance network_info: |[{"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d5efb863-e21c-44fc-94e5-feb83df1a523 req-368ff7ab-88d3-4cb3-9e24-61758553834f service nova] Acquired lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.neutron [req-d5efb863-e21c-44fc-94e5-feb83df1a523 req-368ff7ab-88d3-4cb3-9e24-61758553834f service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Refreshing network info cache for port 21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Start _get_guest_xml network_info=[{"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb4e0a7e-7bb9-5e8b-aa8d-ff4615bc79a2', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:18 user nova-compute[74587]: INFO oslo.privsep.daemon [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpezzs_tyl/privsep.sock']
Oct 18 07:07:18 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:18 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:07:18 user sudo[83872]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpezzs_tyl/privsep.sock
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:07:18 user sudo[83872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-896436249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-896436249',id=3,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-c0vy8pje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:12Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=12b4c420-79fd-4f58-a422-59dc2b89731f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:23:7f,bridge_name='br-int',has_traffic_filtering=True,id=21d53194-906d-4d43-8a10-dc04180809ef,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d53194-90') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.objects.instance [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'pci_devices' on Instance uuid 12b4c420-79fd-4f58-a422-59dc2b89731f {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.neutron [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updating instance_info_cache with network_info: [{"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:07:18 user nova-compute[74587]:   <uuid>12b4c420-79fd-4f58-a422-59dc2b89731f</uuid>
Oct 18 07:07:18 user nova-compute[74587]:   <name>instance-00000003</name>
Oct 18 07:07:18 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:07:18 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:07:18 user nova-compute[74587]:   <metadata>
Oct 18 07:07:18 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:07:18 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-896436249</nova:name>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:07:18</nova:creationTime>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:07:18 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:07:18 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:owner>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:user uuid="e2ca09ce37384d25931eb9a658384255">tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member</nova:user>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:project uuid="c002a125aec54fa388965a9f83cc1624">tempest-ServerBootFromVolumeStableRescueTest-1990729548</nova:project>
Oct 18 07:07:18 user nova-compute[74587]:       </nova:owner>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:ports>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:port uuid="21d53194-906d-4d43-8a10-dc04180809ef">
Oct 18 07:07:18 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 07:07:18 user nova-compute[74587]:         </nova:port>
Oct 18 07:07:18 user nova-compute[74587]:       </nova:ports>
Oct 18 07:07:18 user nova-compute[74587]:     </nova:instance>
Oct 18 07:07:18 user nova-compute[74587]:   </metadata>
Oct 18 07:07:18 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:07:18 user nova-compute[74587]:     <system>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="serial">12b4c420-79fd-4f58-a422-59dc2b89731f</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="uuid">12b4c420-79fd-4f58-a422-59dc2b89731f</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:07:18 user nova-compute[74587]:     </system>
Oct 18 07:07:18 user nova-compute[74587]:   </sysinfo>
Oct 18 07:07:18 user nova-compute[74587]:   <os>
Oct 18 07:07:18 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:07:18 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:07:18 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:07:18 user nova-compute[74587]:   </os>
Oct 18 07:07:18 user nova-compute[74587]:   <features>
Oct 18 07:07:18 user nova-compute[74587]:     <acpi/>
Oct 18 07:07:18 user nova-compute[74587]:     <apic/>
Oct 18 07:07:18 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:07:18 user nova-compute[74587]:   </features>
Oct 18 07:07:18 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:07:18 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:07:18 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:07:18 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:07:18 user nova-compute[74587]:   </clock>
Oct 18 07:07:18 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:07:18 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:07:18 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:07:18 user nova-compute[74587]:   </cpu>
Oct 18 07:07:18 user nova-compute[74587]:   <devices>
Oct 18 07:07:18 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:07:18 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:07:18 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk"/>
Oct 18 07:07:18 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:07:18 user nova-compute[74587]:     </disk>
Oct 18 07:07:18 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:07:18 user nova-compute[74587]:       <mac address="fa:16:3e:d2:23:7f"/>
Oct 18 07:07:18 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:18 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:07:18 user nova-compute[74587]:       <target dev="tap21d53194-90"/>
Oct 18 07:07:18 user nova-compute[74587]:     </interface>
Oct 18 07:07:18 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:07:18 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/console.log" append="off"/>
Oct 18 07:07:18 user nova-compute[74587]:     </serial>
Oct 18 07:07:18 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:07:18 user nova-compute[74587]:     <video>
Oct 18 07:07:18 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:18 user nova-compute[74587]:     </video>
Oct 18 07:07:18 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:07:18 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:07:18 user nova-compute[74587]:     </rng>
Oct 18 07:07:18 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:07:18 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:07:18 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:07:18 user nova-compute[74587]:     </memballoon>
Oct 18 07:07:18 user nova-compute[74587]:   </devices>
Oct 18 07:07:18 user nova-compute[74587]: </domain>
Oct 18 07:07:18 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-896436249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-896436249',id=3,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-c0vy8pje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:12Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=12b4c420-79fd-4f58-a422-59dc2b89731f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:23:7f,bridge_name='br-int',has_traffic_filtering=True,id=21d53194-906d-4d43-8a10-dc04180809ef,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d53194-90') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG os_vif [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:23:7f,bridge_name='br-int',has_traffic_filtering=True,id=21d53194-906d-4d43-8a10-dc04180809ef,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d53194-90') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '306f13d5-13cc-58f8-a735-6946bc8d6c11', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Releasing lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.compute.manager [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Instance network_info: |[{"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Start _get_guest_xml network_info=[{"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:18 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:18 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1979991676',display_name='tempest-ServerRescueNegativeTestJSON-server-1979991676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1979991676',id=2,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-aumf0bef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:10Z,user_data=None,user_id='96efd41052434514aea7fe47a5eb36f7',uuid=d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:14,bridge_name='br-int',has_traffic_filtering=True,id=da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f50ec-04') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.objects.instance [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'pci_devices' on Instance uuid d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:07:18 user nova-compute[74587]:   <uuid>d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7</uuid>
Oct 18 07:07:18 user nova-compute[74587]:   <name>instance-00000002</name>
Oct 18 07:07:18 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:07:18 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:07:18 user nova-compute[74587]:   <metadata>
Oct 18 07:07:18 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:07:18 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1979991676</nova:name>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:07:18</nova:creationTime>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:07:18 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:07:18 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:owner>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:user uuid="96efd41052434514aea7fe47a5eb36f7">tempest-ServerRescueNegativeTestJSON-1222499333-project-member</nova:user>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:project uuid="1b1dbea9d8d34471b74b5c002f5905f0">tempest-ServerRescueNegativeTestJSON-1222499333</nova:project>
Oct 18 07:07:18 user nova-compute[74587]:       </nova:owner>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:07:18 user nova-compute[74587]:       <nova:ports>
Oct 18 07:07:18 user nova-compute[74587]:         <nova:port uuid="da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0">
Oct 18 07:07:18 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 18 07:07:18 user nova-compute[74587]:         </nova:port>
Oct 18 07:07:18 user nova-compute[74587]:       </nova:ports>
Oct 18 07:07:18 user nova-compute[74587]:     </nova:instance>
Oct 18 07:07:18 user nova-compute[74587]:   </metadata>
Oct 18 07:07:18 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:07:18 user nova-compute[74587]:     <system>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="serial">d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="uuid">d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7</entry>
Oct 18 07:07:18 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:07:18 user nova-compute[74587]:     </system>
Oct 18 07:07:18 user nova-compute[74587]:   </sysinfo>
Oct 18 07:07:18 user nova-compute[74587]:   <os>
Oct 18 07:07:18 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:07:18 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:07:18 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:07:18 user nova-compute[74587]:   </os>
Oct 18 07:07:18 user nova-compute[74587]:   <features>
Oct 18 07:07:18 user nova-compute[74587]:     <acpi/>
Oct 18 07:07:18 user nova-compute[74587]:     <apic/>
Oct 18 07:07:18 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:07:18 user nova-compute[74587]:   </features>
Oct 18 07:07:18 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:07:18 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:07:18 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:07:18 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:07:18 user nova-compute[74587]:   </clock>
Oct 18 07:07:18 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:07:18 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:07:18 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:07:18 user nova-compute[74587]:   </cpu>
Oct 18 07:07:18 user nova-compute[74587]:   <devices>
Oct 18 07:07:18 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:07:18 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:07:18 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk"/>
Oct 18 07:07:18 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:07:18 user nova-compute[74587]:     </disk>
Oct 18 07:07:18 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:07:18 user nova-compute[74587]:       <mac address="fa:16:3e:f6:c0:14"/>
Oct 18 07:07:18 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:18 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:07:18 user nova-compute[74587]:       <target dev="tapda3f50ec-04"/>
Oct 18 07:07:18 user nova-compute[74587]:     </interface>
Oct 18 07:07:18 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:07:18 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/console.log" append="off"/>
Oct 18 07:07:18 user nova-compute[74587]:     </serial>
Oct 18 07:07:18 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:07:18 user nova-compute[74587]:     <video>
Oct 18 07:07:18 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:18 user nova-compute[74587]:     </video>
Oct 18 07:07:18 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:07:18 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:07:18 user nova-compute[74587]:     </rng>
Oct 18 07:07:18 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:07:18 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:07:18 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:07:18 user nova-compute[74587]:     </memballoon>
Oct 18 07:07:18 user nova-compute[74587]:   </devices>
Oct 18 07:07:18 user nova-compute[74587]: </domain>
Oct 18 07:07:18 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1979991676',display_name='tempest-ServerRescueNegativeTestJSON-server-1979991676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1979991676',id=2,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-aumf0bef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:10Z,user_data=None,user_id='96efd41052434514aea7fe47a5eb36f7',uuid=d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:14,bridge_name='br-int',has_traffic_filtering=True,id=da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f50ec-04') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG os_vif [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:14,bridge_name='br-int',has_traffic_filtering=True,id=da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f50ec-04') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfa9c4f8-5552-595d-b6f5-0826ecd841d7', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-89f5c895-ff58-45b5-ad7e-9ba9bc0a05a9 req-9f09d3f2-2651-47ad-a8f7-fd6e70cfabd5 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-changed-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-89f5c895-ff58-45b5-ad7e-9ba9bc0a05a9 req-9f09d3f2-2651-47ad-a8f7-fd6e70cfabd5 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Refreshing instance network info cache due to event network-changed-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89f5c895-ff58-45b5-ad7e-9ba9bc0a05a9 req-9f09d3f2-2651-47ad-a8f7-fd6e70cfabd5 service nova] Acquiring lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89f5c895-ff58-45b5-ad7e-9ba9bc0a05a9 req-9f09d3f2-2651-47ad-a8f7-fd6e70cfabd5 service nova] Acquired lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG nova.network.neutron [req-89f5c895-ff58-45b5-ad7e-9ba9bc0a05a9 req-9f09d3f2-2651-47ad-a8f7-fd6e70cfabd5 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Refreshing network info cache for port da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG nova.compute.manager [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:07:19 user nova-compute[74587]: INFO nova.compute.claims [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Claim successful on node user
Oct 18 07:07:19 user sudo[83872]: pam_unix(sudo:session): session closed for user root
Oct 18 07:07:19 user nova-compute[74587]: INFO oslo.privsep.daemon [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Spawned new privsep daemon via rootwrap
Oct 18 07:07:19 user nova-compute[74587]: DEBUG nova.network.neutron [req-12b98b35-b97e-47d3-a53c-d2b008abbb55 req-015525dc-b2f3-4145-9272-3c3a71069278 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updated VIF entry in instance network info cache for port 338116e1-ec57-4c95-987e-d6d72a2b50b3. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:07:19 user nova-compute[74587]: DEBUG nova.network.neutron [req-12b98b35-b97e-47d3-a53c-d2b008abbb55 req-015525dc-b2f3-4145-9272-3c3a71069278 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updating instance_info_cache with network_info: [{"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:19 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 18 07:07:19 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 18 07:07:19 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 18 07:07:19 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83880
Oct 18 07:07:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-12b98b35-b97e-47d3-a53c-d2b008abbb55 req-015525dc-b2f3-4145-9272-3c3a71069278 service nova] Releasing lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:19 user nova-compute[74587]: WARNING oslo_privsep.priv_context [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] privsep daemon already running
Oct 18 07:07:19 user nova-compute[74587]: WARNING oslo_privsep.priv_context [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] privsep daemon already running
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.network.neutron [req-d5efb863-e21c-44fc-94e5-feb83df1a523 req-368ff7ab-88d3-4cb3-9e24-61758553834f service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updated VIF entry in instance network info cache for port 21d53194-906d-4d43-8a10-dc04180809ef. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.network.neutron [req-d5efb863-e21c-44fc-94e5-feb83df1a523 req-368ff7ab-88d3-4cb3-9e24-61758553834f service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updating instance_info_cache with network_info: [{"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d5efb863-e21c-44fc-94e5-feb83df1a523 req-368ff7ab-88d3-4cb3-9e24-61758553834f service nova] Releasing lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.network.neutron [req-89f5c895-ff58-45b5-ad7e-9ba9bc0a05a9 req-9f09d3f2-2651-47ad-a8f7-fd6e70cfabd5 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updated VIF entry in instance network info cache for port da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.network.neutron [req-89f5c895-ff58-45b5-ad7e-9ba9bc0a05a9 req-9f09d3f2-2651-47ad-a8f7-fd6e70cfabd5 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updating instance_info_cache with network_info: [{"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89f5c895-ff58-45b5-ad7e-9ba9bc0a05a9 req-9f09d3f2-2651-47ad-a8f7-fd6e70cfabd5 service nova] Releasing lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.network.neutron [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:07:20 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap338116e1-ec, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap338116e1-ec, col_values=(('qos', UUID('1d20d6fd-301d-4c4f-988a-05f42a5ab3af')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap338116e1-ec, col_values=(('external_ids', {'iface-id': '338116e1-ec57-4c95-987e-d6d72a2b50b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:50:bd', 'vm-uuid': '0d568195-c89b-47e8-9992-bfc3a6c8e929'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:20 user nova-compute[74587]: INFO os_vif [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:50:bd,bridge_name='br-int',has_traffic_filtering=True,id=338116e1-ec57-4c95-987e-d6d72a2b50b3,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338116e1-ec')
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda3f50ec-04, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda3f50ec-04, col_values=(('qos', UUID('af1ba5ec-b9f4-43f9-a278-b38433d92f0a')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda3f50ec-04, col_values=(('external_ids', {'iface-id': 'da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:c0:14', 'vm-uuid': 'd11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:20 user nova-compute[74587]: INFO os_vif [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:14,bridge_name='br-int',has_traffic_filtering=True,id=da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f50ec-04')
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21d53194-90, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21d53194-90, col_values=(('qos', UUID('573f6901-d475-4472-b4e2-6a31557e8b99')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21d53194-90, col_values=(('external_ids', {'iface-id': '21d53194-906d-4d43-8a10-dc04180809ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:23:7f', 'vm-uuid': '12b4c420-79fd-4f58-a422-59dc2b89731f'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:20 user nova-compute[74587]: INFO os_vif [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:23:7f,bridge_name='br-int',has_traffic_filtering=True,id=21d53194-906d-4d43-8a10-dc04180809ef,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d53194-90')
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No VIF found with MAC fa:16:3e:5f:50:bd, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No VIF found with MAC fa:16:3e:d2:23:7f, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No VIF found with MAC fa:16:3e:f6:c0:14, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:07:20 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Creating image(s)
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "/opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "/opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG nova.policy [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fc135a6446545888ff24712eefb1b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a7454d9f14afbb50a0588fa3da19f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.292s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk 1073741824" returned: 0 in 0.048s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Cannot resize image /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Ensure instance console log exists: /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Successfully created port: 1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:07:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Successfully updated port: 1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquired lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG nova.compute.manager [req-49c84216-8423-49b0-89f0-4a127b6722a3 req-21ef4c04-4e51-457c-8536-445c9d591166 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-changed-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG nova.compute.manager [req-49c84216-8423-49b0-89f0-4a127b6722a3 req-21ef4c04-4e51-457c-8536-445c9d591166 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Refreshing instance network info cache due to event network-changed-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-49c84216-8423-49b0-89f0-4a127b6722a3 req-21ef4c04-4e51-457c-8536-445c9d591166 service nova] Acquiring lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:07:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating instance_info_cache with network_info: [{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Releasing lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance network_info: |[{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-49c84216-8423-49b0-89f0-4a127b6722a3 req-21ef4c04-4e51-457c-8536-445c9d591166 service nova] Acquired lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.network.neutron [req-49c84216-8423-49b0-89f0-4a127b6722a3 req-21ef4c04-4e51-457c-8536-445c9d591166 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Refreshing network info cache for port 1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Start _get_guest_xml network_info=[{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:07:25 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:25 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-755684932',display_name='tempest-ServerActionsTestOtherB-server-755684932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-755684932',id=4,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8stB7NcHNVX73tIwXaWmwjt5Z5Gy40wrIxjnndsSfNN8+LA5rjRswbgNHk/MPUZkNT6gLl8Vo+PjF4hhdbnZF62iCxOpmdu8UPwTjCHb48/H//aH3JFzmyPPPDesN3zA==',key_name='tempest-keypair-1877047546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='658a7454d9f14afbb50a0588fa3da19f',ramdisk_id='',reservation_id='r-kaimmc3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2137467099',owner_user_name='tempest-ServerActionsTestOtherB-2137467099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc135a6446545888ff24712eefb1b3e',uuid=dc1910eb-a1c1-4310-ba25-42ac6e4d724b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converting VIF {"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.objects.instance [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lazy-loading 'pci_devices' on Instance uuid dc1910eb-a1c1-4310-ba25-42ac6e4d724b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:07:25 user nova-compute[74587]:   <uuid>dc1910eb-a1c1-4310-ba25-42ac6e4d724b</uuid>
Oct 18 07:07:25 user nova-compute[74587]:   <name>instance-00000004</name>
Oct 18 07:07:25 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:07:25 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:07:25 user nova-compute[74587]:   <metadata>
Oct 18 07:07:25 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:07:25 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:07:25 user nova-compute[74587]:       <nova:name>tempest-ServerActionsTestOtherB-server-755684932</nova:name>
Oct 18 07:07:25 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:07:25</nova:creationTime>
Oct 18 07:07:25 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:07:25 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:07:25 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:07:25 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:07:25 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:07:25 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:07:25 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:07:25 user nova-compute[74587]:       <nova:owner>
Oct 18 07:07:25 user nova-compute[74587]:         <nova:user uuid="1fc135a6446545888ff24712eefb1b3e">tempest-ServerActionsTestOtherB-2137467099-project-member</nova:user>
Oct 18 07:07:25 user nova-compute[74587]:         <nova:project uuid="658a7454d9f14afbb50a0588fa3da19f">tempest-ServerActionsTestOtherB-2137467099</nova:project>
Oct 18 07:07:25 user nova-compute[74587]:       </nova:owner>
Oct 18 07:07:25 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:07:25 user nova-compute[74587]:       <nova:ports>
Oct 18 07:07:25 user nova-compute[74587]:         <nova:port uuid="1f61b2a7-a701-4ffd-bf37-76309f8f9b5a">
Oct 18 07:07:25 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 07:07:25 user nova-compute[74587]:         </nova:port>
Oct 18 07:07:25 user nova-compute[74587]:       </nova:ports>
Oct 18 07:07:25 user nova-compute[74587]:     </nova:instance>
Oct 18 07:07:25 user nova-compute[74587]:   </metadata>
Oct 18 07:07:25 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:07:25 user nova-compute[74587]:     <system>
Oct 18 07:07:25 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:07:25 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:07:25 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:07:25 user nova-compute[74587]:       <entry name="serial">dc1910eb-a1c1-4310-ba25-42ac6e4d724b</entry>
Oct 18 07:07:25 user nova-compute[74587]:       <entry name="uuid">dc1910eb-a1c1-4310-ba25-42ac6e4d724b</entry>
Oct 18 07:07:25 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:07:25 user nova-compute[74587]:     </system>
Oct 18 07:07:25 user nova-compute[74587]:   </sysinfo>
Oct 18 07:07:25 user nova-compute[74587]:   <os>
Oct 18 07:07:25 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:07:25 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:07:25 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:07:25 user nova-compute[74587]:   </os>
Oct 18 07:07:25 user nova-compute[74587]:   <features>
Oct 18 07:07:25 user nova-compute[74587]:     <acpi/>
Oct 18 07:07:25 user nova-compute[74587]:     <apic/>
Oct 18 07:07:25 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:07:25 user nova-compute[74587]:   </features>
Oct 18 07:07:25 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:07:25 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:07:25 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:07:25 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:07:25 user nova-compute[74587]:   </clock>
Oct 18 07:07:25 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:07:25 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:07:25 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:07:25 user nova-compute[74587]:   </cpu>
Oct 18 07:07:25 user nova-compute[74587]:   <devices>
Oct 18 07:07:25 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:07:25 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:07:25 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk"/>
Oct 18 07:07:25 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:07:25 user nova-compute[74587]:     </disk>
Oct 18 07:07:25 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:07:25 user nova-compute[74587]:       <mac address="fa:16:3e:1a:0b:de"/>
Oct 18 07:07:25 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:25 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:07:25 user nova-compute[74587]:       <target dev="tap1f61b2a7-a7"/>
Oct 18 07:07:25 user nova-compute[74587]:     </interface>
Oct 18 07:07:25 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:07:25 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/console.log" append="off"/>
Oct 18 07:07:25 user nova-compute[74587]:     </serial>
Oct 18 07:07:25 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:07:25 user nova-compute[74587]:     <video>
Oct 18 07:07:25 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:25 user nova-compute[74587]:     </video>
Oct 18 07:07:25 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:07:25 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:07:25 user nova-compute[74587]:     </rng>
Oct 18 07:07:25 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:07:25 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:07:25 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:07:25 user nova-compute[74587]:     </memballoon>
Oct 18 07:07:25 user nova-compute[74587]:   </devices>
Oct 18 07:07:25 user nova-compute[74587]: </domain>
Oct 18 07:07:25 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-755684932',display_name='tempest-ServerActionsTestOtherB-server-755684932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-755684932',id=4,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8stB7NcHNVX73tIwXaWmwjt5Z5Gy40wrIxjnndsSfNN8+LA5rjRswbgNHk/MPUZkNT6gLl8Vo+PjF4hhdbnZF62iCxOpmdu8UPwTjCHb48/H//aH3JFzmyPPPDesN3zA==',key_name='tempest-keypair-1877047546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='658a7454d9f14afbb50a0588fa3da19f',ramdisk_id='',reservation_id='r-kaimmc3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2137467099',owner_user_name='tempest-ServerActionsTestOtherB-2137467099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc135a6446545888ff24712eefb1b3e',uuid=dc1910eb-a1c1-4310-ba25-42ac6e4d724b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converting VIF {"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG os_vif [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6c1b0ab-7ed6-5b97-90e0-aed1c2dd7ebe', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f61b2a7-a7, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f61b2a7-a7, col_values=(('qos', UUID('a39d8756-4015-4eb3-a057-3596377c18f5')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f61b2a7-a7, col_values=(('external_ids', {'iface-id': '1f61b2a7-a701-4ffd-bf37-76309f8f9b5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:0b:de', 'vm-uuid': 'dc1910eb-a1c1-4310-ba25-42ac6e4d724b'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:25 user nova-compute[74587]: INFO os_vif [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7')
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] No VIF found with MAC fa:16:3e:1a:0b:de, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-49c84216-8423-49b0-89f0-4a127b6722a3 req-21ef4c04-4e51-457c-8536-445c9d591166 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updated VIF entry in instance network info cache for port 1f61b2a7-a701-4ffd-bf37-76309f8f9b5a. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:07:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-49c84216-8423-49b0-89f0-4a127b6722a3 req-21ef4c04-4e51-457c-8536-445c9d591166 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating instance_info_cache with network_info: [{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-49c84216-8423-49b0-89f0-4a127b6722a3 req-21ef4c04-4e51-457c-8536-445c9d591166 service nova] Releasing lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:07:27 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Instance spawned successfully.
Oct 18 07:07:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:28 user nova-compute[74587]: INFO nova.compute.manager [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Took 18.25 seconds to spawn the instance on the hypervisor.
Oct 18 07:07:28 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:07:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:28 user nova-compute[74587]: INFO nova.compute.manager [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Took 19.72 seconds to build instance.
Oct 18 07:07:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d2bb22ab-0886-4420-9e3d-7a7cb9c98186 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.152s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.compute.manager [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:07:29 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Instance spawned successfully.
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:07:29 user nova-compute[74587]: INFO nova.compute.manager [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Took 18.83 seconds to spawn the instance on the hypervisor.
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.compute.manager [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:29 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Instance spawned successfully.
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:29 user nova-compute[74587]: INFO nova.compute.manager [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Took 20.18 seconds to build instance.
Oct 18 07:07:29 user nova-compute[74587]: INFO nova.compute.manager [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Took 17.34 seconds to spawn the instance on the hypervisor.
Oct 18 07:07:29 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:07:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-56f01d96-f654-4a13-9a7f-8a295e9ccfb9 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.448s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:29 user nova-compute[74587]: INFO nova.compute.manager [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Took 18.71 seconds to build instance.
Oct 18 07:07:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fab2f107-ff6d-4d98-8c73-a2150daaf0b5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.428s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:07:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:07:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance spawned successfully.
Oct 18 07:07:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:07:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:30 user nova-compute[74587]: INFO nova.compute.manager [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Took 10.14 seconds to spawn the instance on the hypervisor.
Oct 18 07:07:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:07:30 user nova-compute[74587]: INFO nova.compute.manager [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Took 11.16 seconds to build instance.
Oct 18 07:07:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-546dd750-6e82-4ab0-aadd-1c3d94efecad tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.305s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:36 user nova-compute[74587]: DEBUG nova.compute.manager [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:07:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:07:36 user nova-compute[74587]: INFO nova.compute.claims [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Claim successful on node user
Oct 18 07:07:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:07:37 user nova-compute[74587]: INFO nova.compute.claims [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Claim successful on node user
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.network.neutron [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:07:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.policy [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6f3e19629ad4476979f7fceb2f418b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2099973a6f465e800ba0cf704ebde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:07:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Creating image(s)
Oct 18 07:07:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "/opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "/opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:07:37 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb.part --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.991s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:07:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:07:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb.part --force-share --output=json" returned: 0 in 0.255s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG nova.virt.images [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] 9081d5ac-49c6-4e88-b0b0-2fa83760a211 was qcow2, converting to raw {{(pid=74587) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb.part /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb.converted {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG nova.policy [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a62f8993664c4570951ba81a466d61fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8810ffdaefbd441db8632657ab4e9e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Successfully created port: 3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb.part /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb.converted" returned: 0 in 0.290s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb.converted --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:07:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Creating image(s)
Oct 18 07:07:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "/opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "/opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.216s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb.converted --force-share --output=json" returned: 0 in 0.346s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.409s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.234s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk 1073741824" returned: 0 in 0.075s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb --force-share --output=json" returned: 0 in 0.320s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Successfully created port: d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.347s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb --force-share --output=json" returned: 0 in 0.382s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb,backing_fmt=raw /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Cannot resize image /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Ensure instance console log exists: /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb,backing_fmt=raw /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk 1073741824" returned: 0 in 0.560s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.949s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Successfully updated port: 3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "refresh_cache-4ef9e718-1203-413a-909f-b0cf90a5b2b9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquired lock "refresh_cache-4ef9e718-1203-413a-909f-b0cf90a5b2b9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-f5e9a9af-b67b-4903-95bc-fe141f63dce5 req-6c458179-15fe-43a5-bc0b-72b10620cffa service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received event network-changed-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-f5e9a9af-b67b-4903-95bc-fe141f63dce5 req-6c458179-15fe-43a5-bc0b-72b10620cffa service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Refreshing instance network info cache due to event network-changed-3bf1510a-3efc-4d46-b016-ffeacfc7025e. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f5e9a9af-b67b-4903-95bc-fe141f63dce5 req-6c458179-15fe-43a5-bc0b-72b10620cffa service nova] Acquiring lock "refresh_cache-4ef9e718-1203-413a-909f-b0cf90a5b2b9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb --force-share --output=json" returned: 0 in 0.257s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:07:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Cannot resize image /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Ensure instance console log exists: /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.network.neutron [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Updating instance_info_cache with network_info: [{"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Releasing lock "refresh_cache-4ef9e718-1203-413a-909f-b0cf90a5b2b9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Instance network_info: |[{"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f5e9a9af-b67b-4903-95bc-fe141f63dce5 req-6c458179-15fe-43a5-bc0b-72b10620cffa service nova] Acquired lock "refresh_cache-4ef9e718-1203-413a-909f-b0cf90a5b2b9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.network.neutron [req-f5e9a9af-b67b-4903-95bc-fe141f63dce5 req-6c458179-15fe-43a5-bc0b-72b10620cffa service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Refreshing network info cache for port 3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Start _get_guest_xml network_info=[{"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:07:27Z,direct_url=<?>,disk_format='qcow2',id=9081d5ac-49c6-4e88-b0b0-2fa83760a211,min_disk=0,min_ram=0,name='',owner='d0e58ec268dd4fc2839590be2648c4f6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:07:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/sda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'scsi', 'guest_format': None, 'image_id': '9081d5ac-49c6-4e88-b0b0-2fa83760a211'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:07:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:07:27Z,direct_url=<?>,disk_format='qcow2',id=9081d5ac-49c6-4e88-b0b0-2fa83760a211,min_disk=0,min_ram=0,name='',owner='d0e58ec268dd4fc2839590be2648c4f6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:07:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1269783988',display_name='tempest-AttachSCSIVolumeTestJSON-server-1269783988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1269783988',id=5,image_ref='9081d5ac-49c6-4e88-b0b0-2fa83760a211',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk9XGlGFifE3Ub4pid/aptPLLb6u4UD/Rb1FswGlAupYvxUIkMDFgURyp1+d+SEZR/NiVi8MfYJ/3WPkOUWtAhQM6gI3rRkv/xbRYgP/Jx2uGp3CUei1vFTBPtslCU6VQ==',key_name='tempest-keypair-1663419770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b2099973a6f465e800ba0cf704ebde6',ramdisk_id='',reservation_id='r-508grw0a',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9081d5ac-49c6-4e88-b0b0-2fa83760a211',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-26652777',owner_user_name='tempest-AttachSCSIVolumeTestJSON-26652777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6f3e19629ad4476979f7fceb2f418b5',uuid=4ef9e718-1203-413a-909f-b0cf90a5b2b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Converting VIF {"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:e7:a8,bridge_name='br-int',has_traffic_filtering=True,id=3bf1510a-3efc-4d46-b016-ffeacfc7025e,network=Network(fe6f0bef-dd63-4c68-a83c-d5881437cf08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf1510a-3e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.objects.instance [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ef9e718-1203-413a-909f-b0cf90a5b2b9 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:07:41 user nova-compute[74587]:   <uuid>4ef9e718-1203-413a-909f-b0cf90a5b2b9</uuid>
Oct 18 07:07:41 user nova-compute[74587]:   <name>instance-00000005</name>
Oct 18 07:07:41 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:07:41 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:07:41 user nova-compute[74587]:   <metadata>
Oct 18 07:07:41 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:07:41 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:07:41 user nova-compute[74587]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1269783988</nova:name>
Oct 18 07:07:41 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:07:41</nova:creationTime>
Oct 18 07:07:41 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:07:41 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:07:41 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:07:41 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:07:41 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:07:41 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:07:41 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:07:41 user nova-compute[74587]:       <nova:owner>
Oct 18 07:07:41 user nova-compute[74587]:         <nova:user uuid="a6f3e19629ad4476979f7fceb2f418b5">tempest-AttachSCSIVolumeTestJSON-26652777-project-member</nova:user>
Oct 18 07:07:41 user nova-compute[74587]:         <nova:project uuid="8b2099973a6f465e800ba0cf704ebde6">tempest-AttachSCSIVolumeTestJSON-26652777</nova:project>
Oct 18 07:07:41 user nova-compute[74587]:       </nova:owner>
Oct 18 07:07:41 user nova-compute[74587]:       <nova:root type="image" uuid="9081d5ac-49c6-4e88-b0b0-2fa83760a211"/>
Oct 18 07:07:41 user nova-compute[74587]:       <nova:ports>
Oct 18 07:07:41 user nova-compute[74587]:         <nova:port uuid="3bf1510a-3efc-4d46-b016-ffeacfc7025e">
Oct 18 07:07:41 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 18 07:07:41 user nova-compute[74587]:         </nova:port>
Oct 18 07:07:41 user nova-compute[74587]:       </nova:ports>
Oct 18 07:07:41 user nova-compute[74587]:     </nova:instance>
Oct 18 07:07:41 user nova-compute[74587]:   </metadata>
Oct 18 07:07:41 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:07:41 user nova-compute[74587]:     <system>
Oct 18 07:07:41 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:07:41 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:07:41 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:07:41 user nova-compute[74587]:       <entry name="serial">4ef9e718-1203-413a-909f-b0cf90a5b2b9</entry>
Oct 18 07:07:41 user nova-compute[74587]:       <entry name="uuid">4ef9e718-1203-413a-909f-b0cf90a5b2b9</entry>
Oct 18 07:07:41 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:07:41 user nova-compute[74587]:     </system>
Oct 18 07:07:41 user nova-compute[74587]:   </sysinfo>
Oct 18 07:07:41 user nova-compute[74587]:   <os>
Oct 18 07:07:41 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:07:41 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:07:41 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:07:41 user nova-compute[74587]:   </os>
Oct 18 07:07:41 user nova-compute[74587]:   <features>
Oct 18 07:07:41 user nova-compute[74587]:     <acpi/>
Oct 18 07:07:41 user nova-compute[74587]:     <apic/>
Oct 18 07:07:41 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:07:41 user nova-compute[74587]:   </features>
Oct 18 07:07:41 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:07:41 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:07:41 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:07:41 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:07:41 user nova-compute[74587]:   </clock>
Oct 18 07:07:41 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:07:41 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:07:41 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:07:41 user nova-compute[74587]:   </cpu>
Oct 18 07:07:41 user nova-compute[74587]:   <devices>
Oct 18 07:07:41 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:07:41 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:07:41 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk"/>
Oct 18 07:07:41 user nova-compute[74587]:       <target dev="sda" bus="scsi"/>
Oct 18 07:07:41 user nova-compute[74587]:       <address type="drive" controller="0" unit="0"/>
Oct 18 07:07:41 user nova-compute[74587]:     </disk>
Oct 18 07:07:41 user nova-compute[74587]:     <disk type="file" device="cdrom">
Oct 18 07:07:41 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none"/>
Oct 18 07:07:41 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk.config"/>
Oct 18 07:07:41 user nova-compute[74587]:       <target dev="sdb" bus="scsi"/>
Oct 18 07:07:41 user nova-compute[74587]:       <address type="drive" controller="0" unit="1"/>
Oct 18 07:07:41 user nova-compute[74587]:     </disk>
Oct 18 07:07:41 user nova-compute[74587]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 18 07:07:41 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:07:41 user nova-compute[74587]:       <mac address="fa:16:3e:02:e7:a8"/>
Oct 18 07:07:41 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:41 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:07:41 user nova-compute[74587]:       <target dev="tap3bf1510a-3e"/>
Oct 18 07:07:41 user nova-compute[74587]:     </interface>
Oct 18 07:07:41 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:07:41 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/console.log" append="off"/>
Oct 18 07:07:41 user nova-compute[74587]:     </serial>
Oct 18 07:07:41 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:07:41 user nova-compute[74587]:     <video>
Oct 18 07:07:41 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:41 user nova-compute[74587]:     </video>
Oct 18 07:07:41 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:07:41 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:07:41 user nova-compute[74587]:     </rng>
Oct 18 07:07:41 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:07:41 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:07:41 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:07:41 user nova-compute[74587]:     </memballoon>
Oct 18 07:07:41 user nova-compute[74587]:   </devices>
Oct 18 07:07:41 user nova-compute[74587]: </domain>
Oct 18 07:07:41 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1269783988',display_name='tempest-AttachSCSIVolumeTestJSON-server-1269783988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1269783988',id=5,image_ref='9081d5ac-49c6-4e88-b0b0-2fa83760a211',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk9XGlGFifE3Ub4pid/aptPLLb6u4UD/Rb1FswGlAupYvxUIkMDFgURyp1+d+SEZR/NiVi8MfYJ/3WPkOUWtAhQM6gI3rRkv/xbRYgP/Jx2uGp3CUei1vFTBPtslCU6VQ==',key_name='tempest-keypair-1663419770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b2099973a6f465e800ba0cf704ebde6',ramdisk_id='',reservation_id='r-508grw0a',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9081d5ac-49c6-4e88-b0b0-2fa83760a211',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-26652777',owner_user_name='tempest-AttachSCSIVolumeTestJSON-26652777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6f3e19629ad4476979f7fceb2f418b5',uuid=4ef9e718-1203-413a-909f-b0cf90a5b2b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Converting VIF {"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:e7:a8,bridge_name='br-int',has_traffic_filtering=True,id=3bf1510a-3efc-4d46-b016-ffeacfc7025e,network=Network(fe6f0bef-dd63-4c68-a83c-d5881437cf08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf1510a-3e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG os_vif [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:e7:a8,bridge_name='br-int',has_traffic_filtering=True,id=3bf1510a-3efc-4d46-b016-ffeacfc7025e,network=Network(fe6f0bef-dd63-4c68-a83c-d5881437cf08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf1510a-3e') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a6973ef-5e59-5510-8ae4-a727c959f1b8', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bf1510a-3e, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3bf1510a-3e, col_values=(('qos', UUID('a9b2b46b-794c-4165-827c-402eb0abccbb')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3bf1510a-3e, col_values=(('external_ids', {'iface-id': '3bf1510a-3efc-4d46-b016-ffeacfc7025e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:e7:a8', 'vm-uuid': '4ef9e718-1203-413a-909f-b0cf90a5b2b9'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:41 user nova-compute[74587]: INFO os_vif [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:e7:a8,bridge_name='br-int',has_traffic_filtering=True,id=3bf1510a-3efc-4d46-b016-ffeacfc7025e,network=Network(fe6f0bef-dd63-4c68-a83c-d5881437cf08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf1510a-3e')
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] No BDM found with device name sda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] No VIF found with MAC fa:16:3e:02:e7:a8, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:07:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Using config drive
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Successfully updated port: d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-d3e71fff-8c36-4d4e-a56a-dd285e7d38c3 req-4c64369b-5859-4c42-8d5a-aa579ef66930 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received event network-changed-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-d3e71fff-8c36-4d4e-a56a-dd285e7d38c3 req-4c64369b-5859-4c42-8d5a-aa579ef66930 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Refreshing instance network info cache due to event network-changed-d128c6b4-8685-4248-bb78-1aafbf1ac017. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d3e71fff-8c36-4d4e-a56a-dd285e7d38c3 req-4c64369b-5859-4c42-8d5a-aa579ef66930 service nova] Acquiring lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d3e71fff-8c36-4d4e-a56a-dd285e7d38c3 req-4c64369b-5859-4c42-8d5a-aa579ef66930 service nova] Acquired lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.network.neutron [req-d3e71fff-8c36-4d4e-a56a-dd285e7d38c3 req-4c64369b-5859-4c42-8d5a-aa579ef66930 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Refreshing network info cache for port d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:41 user nova-compute[74587]: DEBUG nova.network.neutron [req-d3e71fff-8c36-4d4e-a56a-dd285e7d38c3 req-4c64369b-5859-4c42-8d5a-aa579ef66930 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-f5e9a9af-b67b-4903-95bc-fe141f63dce5 req-6c458179-15fe-43a5-bc0b-72b10620cffa service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Updated VIF entry in instance network info cache for port 3bf1510a-3efc-4d46-b016-ffeacfc7025e. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-f5e9a9af-b67b-4903-95bc-fe141f63dce5 req-6c458179-15fe-43a5-bc0b-72b10620cffa service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Updating instance_info_cache with network_info: [{"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f5e9a9af-b67b-4903-95bc-fe141f63dce5 req-6c458179-15fe-43a5-bc0b-72b10620cffa service nova] Releasing lock "refresh_cache-4ef9e718-1203-413a-909f-b0cf90a5b2b9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Creating config drive at /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk.config
Oct 18 07:07:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp017vxhhu {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp017vxhhu" returned: 0 in 0.073s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-d3e71fff-8c36-4d4e-a56a-dd285e7d38c3 req-4c64369b-5859-4c42-8d5a-aa579ef66930 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d3e71fff-8c36-4d4e-a56a-dd285e7d38c3 req-4c64369b-5859-4c42-8d5a-aa579ef66930 service nova] Releasing lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquired lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Updating instance_info_cache with network_info: [{"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Releasing lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:42 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Instance network_info: |[{"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Start _get_guest_xml network_info=[{"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:07:43 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:43 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-576936251',display_name='tempest-VolumesAdminNegativeTest-server-576936251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-576936251',id=6,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1UmAKDgrCfAHTXVQTjX+L5+Dx2ZBaevFOLDhpP5qFDVCmcP1C4HdjNsSRtlPMvhYx+cQdXJJLCNcWSf/z4PcJtFgC/gZ9aGF5CiAVZr8wuZwMKvzt+ieCGuraFvcAs8A==',key_name='tempest-keypair-1515749912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8810ffdaefbd441db8632657ab4e9e60',ramdisk_id='',reservation_id='r-4zzlm1sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-312543909',owner_user_name='tempest-VolumesAdminNegativeTest-312543909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a62f8993664c4570951ba81a466d61fd',uuid=3cb1d8fe-2aa4-4182-a03c-31d1baac2f51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converting VIF {"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d128c6b4-8685-4248-bb78-1aafbf1ac017,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd128c6b4-86') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.objects.instance [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:07:43 user nova-compute[74587]:   <uuid>3cb1d8fe-2aa4-4182-a03c-31d1baac2f51</uuid>
Oct 18 07:07:43 user nova-compute[74587]:   <name>instance-00000006</name>
Oct 18 07:07:43 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:07:43 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:07:43 user nova-compute[74587]:   <metadata>
Oct 18 07:07:43 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:07:43 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:07:43 user nova-compute[74587]:       <nova:name>tempest-VolumesAdminNegativeTest-server-576936251</nova:name>
Oct 18 07:07:43 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:07:43</nova:creationTime>
Oct 18 07:07:43 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:07:43 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:07:43 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:07:43 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:07:43 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:07:43 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:07:43 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:07:43 user nova-compute[74587]:       <nova:owner>
Oct 18 07:07:43 user nova-compute[74587]:         <nova:user uuid="a62f8993664c4570951ba81a466d61fd">tempest-VolumesAdminNegativeTest-312543909-project-member</nova:user>
Oct 18 07:07:43 user nova-compute[74587]:         <nova:project uuid="8810ffdaefbd441db8632657ab4e9e60">tempest-VolumesAdminNegativeTest-312543909</nova:project>
Oct 18 07:07:43 user nova-compute[74587]:       </nova:owner>
Oct 18 07:07:43 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:07:43 user nova-compute[74587]:       <nova:ports>
Oct 18 07:07:43 user nova-compute[74587]:         <nova:port uuid="d128c6b4-8685-4248-bb78-1aafbf1ac017">
Oct 18 07:07:43 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 18 07:07:43 user nova-compute[74587]:         </nova:port>
Oct 18 07:07:43 user nova-compute[74587]:       </nova:ports>
Oct 18 07:07:43 user nova-compute[74587]:     </nova:instance>
Oct 18 07:07:43 user nova-compute[74587]:   </metadata>
Oct 18 07:07:43 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:07:43 user nova-compute[74587]:     <system>
Oct 18 07:07:43 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:07:43 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:07:43 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:07:43 user nova-compute[74587]:       <entry name="serial">3cb1d8fe-2aa4-4182-a03c-31d1baac2f51</entry>
Oct 18 07:07:43 user nova-compute[74587]:       <entry name="uuid">3cb1d8fe-2aa4-4182-a03c-31d1baac2f51</entry>
Oct 18 07:07:43 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:07:43 user nova-compute[74587]:     </system>
Oct 18 07:07:43 user nova-compute[74587]:   </sysinfo>
Oct 18 07:07:43 user nova-compute[74587]:   <os>
Oct 18 07:07:43 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:07:43 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:07:43 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:07:43 user nova-compute[74587]:   </os>
Oct 18 07:07:43 user nova-compute[74587]:   <features>
Oct 18 07:07:43 user nova-compute[74587]:     <acpi/>
Oct 18 07:07:43 user nova-compute[74587]:     <apic/>
Oct 18 07:07:43 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:07:43 user nova-compute[74587]:   </features>
Oct 18 07:07:43 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:07:43 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:07:43 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:07:43 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:07:43 user nova-compute[74587]:   </clock>
Oct 18 07:07:43 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:07:43 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:07:43 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:07:43 user nova-compute[74587]:   </cpu>
Oct 18 07:07:43 user nova-compute[74587]:   <devices>
Oct 18 07:07:43 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:07:43 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:07:43 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk"/>
Oct 18 07:07:43 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:07:43 user nova-compute[74587]:     </disk>
Oct 18 07:07:43 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:07:43 user nova-compute[74587]:       <mac address="fa:16:3e:40:00:0f"/>
Oct 18 07:07:43 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:43 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:07:43 user nova-compute[74587]:       <target dev="tapd128c6b4-86"/>
Oct 18 07:07:43 user nova-compute[74587]:     </interface>
Oct 18 07:07:43 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:07:43 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/console.log" append="off"/>
Oct 18 07:07:43 user nova-compute[74587]:     </serial>
Oct 18 07:07:43 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:07:43 user nova-compute[74587]:     <video>
Oct 18 07:07:43 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:43 user nova-compute[74587]:     </video>
Oct 18 07:07:43 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:07:43 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:07:43 user nova-compute[74587]:     </rng>
Oct 18 07:07:43 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:07:43 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:07:43 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:07:43 user nova-compute[74587]:     </memballoon>
Oct 18 07:07:43 user nova-compute[74587]:   </devices>
Oct 18 07:07:43 user nova-compute[74587]: </domain>
Oct 18 07:07:43 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-576936251',display_name='tempest-VolumesAdminNegativeTest-server-576936251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-576936251',id=6,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1UmAKDgrCfAHTXVQTjX+L5+Dx2ZBaevFOLDhpP5qFDVCmcP1C4HdjNsSRtlPMvhYx+cQdXJJLCNcWSf/z4PcJtFgC/gZ9aGF5CiAVZr8wuZwMKvzt+ieCGuraFvcAs8A==',key_name='tempest-keypair-1515749912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8810ffdaefbd441db8632657ab4e9e60',ramdisk_id='',reservation_id='r-4zzlm1sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-312543909',owner_user_name='tempest-VolumesAdminNegativeTest-312543909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a62f8993664c4570951ba81a466d61fd',uuid=3cb1d8fe-2aa4-4182-a03c-31d1baac2f51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converting VIF {"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d128c6b4-8685-4248-bb78-1aafbf1ac017,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd128c6b4-86') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG os_vif [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d128c6b4-8685-4248-bb78-1aafbf1ac017,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd128c6b4-86') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0dfbf9fa-bb81-5f95-bf74-4c9d4e50e589', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd128c6b4-86, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd128c6b4-86, col_values=(('qos', UUID('cdf2f3e5-7038-4bc2-a409-792c4ecbec0b')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd128c6b4-86, col_values=(('external_ids', {'iface-id': 'd128c6b4-8685-4248-bb78-1aafbf1ac017', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:00:0f', 'vm-uuid': '3cb1d8fe-2aa4-4182-a03c-31d1baac2f51'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:43 user nova-compute[74587]: INFO os_vif [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d128c6b4-8685-4248-bb78-1aafbf1ac017,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd128c6b4-86')
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:07:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] No VIF found with MAC fa:16:3e:40:00:0f, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:07:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:07:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-af2fa1cc-de59-4de4-a3b9-0f830387c3ca req-9c0e1352-cac3-4611-a8b6-5c2846ac19f6 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-af2fa1cc-de59-4de4-a3b9-0f830387c3ca req-9c0e1352-cac3-4611-a8b6-5c2846ac19f6 service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-af2fa1cc-de59-4de4-a3b9-0f830387c3ca req-9c0e1352-cac3-4611-a8b6-5c2846ac19f6 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-af2fa1cc-de59-4de4-a3b9-0f830387c3ca req-9c0e1352-cac3-4611-a8b6-5c2846ac19f6 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-af2fa1cc-de59-4de4-a3b9-0f830387c3ca req-9c0e1352-cac3-4611-a8b6-5c2846ac19f6 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:07:46 user nova-compute[74587]: WARNING nova.compute.manager [req-af2fa1cc-de59-4de4-a3b9-0f830387c3ca req-9c0e1352-cac3-4611-a8b6-5c2846ac19f6 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state active and task_state None.
Oct 18 07:07:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:07:47 user nova-compute[74587]: INFO nova.compute.claims [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Claim successful on node user
Oct 18 07:07:47 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:07:47 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:07:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:47 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:07:47 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:07:47 user nova-compute[74587]: DEBUG nova.network.neutron [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:07:47 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:07:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG nova.policy [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42bc78aefa2847238a3b25da59c9a148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884f75b337bf4ab5b239e3e1e16954ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:07:48 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Creating image(s)
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.255s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.205s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk 1073741824" returned: 0 in 0.053s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:07:49 user nova-compute[74587]: INFO nova.compute.claims [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Claim successful on node user
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:07:49 user nova-compute[74587]: WARNING nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state active and task_state None.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] No waiting events found dispatching network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:07:49 user nova-compute[74587]: WARNING nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received unexpected event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 for instance with vm_state active and task_state None.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] No waiting events found dispatching network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:07:49 user nova-compute[74587]: WARNING nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received unexpected event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 for instance with vm_state active and task_state None.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] No waiting events found dispatching network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:07:49 user nova-compute[74587]: WARNING nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received unexpected event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef for instance with vm_state active and task_state None.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] No waiting events found dispatching network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:07:49 user nova-compute[74587]: WARNING nova.compute.manager [req-a036f045-f4ba-424c-9e97-f42d85f23eee req-2b1b9396-55c9-4538-83b2-a8f142811742 service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received unexpected event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef for instance with vm_state active and task_state None.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:07:49 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Instance spawned successfully.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.245s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:07:49 user nova-compute[74587]: INFO nova.compute.manager [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Took 11.49 seconds to spawn the instance on the hypervisor.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:07:49 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Instance spawned successfully.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Cannot resize image /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Ensure instance console log exists: /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:49 user nova-compute[74587]: INFO nova.compute.manager [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Took 10.49 seconds to spawn the instance on the hypervisor.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:07:49 user nova-compute[74587]: INFO nova.compute.manager [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Took 12.74 seconds to build instance.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-aafc7501-2f93-41fe-909b-024393359778 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.925s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:49 user nova-compute[74587]: INFO nova.compute.manager [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Took 12.27 seconds to build instance.
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6b21f451-2c22-4797-a04e-06e03bdb2490 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.503s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Successfully created port: ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:07:49 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:07:49 user nova-compute[74587]: DEBUG nova.policy [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e30aa1cbe46c4bf6a8a82e3c8adff031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5bfc6e6c3e4a31a776c8039fb68cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:07:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Creating image(s)
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "/opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "/opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "/opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.224s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG nova.network.neutron [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Successfully updated port: ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.226s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquired lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG nova.network.neutron [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk 1073741824" returned: 0 in 0.072s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Successfully created port: 0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG nova.network.neutron [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.192s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Checking if we can resize image /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Cannot resize image /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Ensure instance console log exists: /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updating instance_info_cache with network_info: [{"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-46fc56e6-1ada-4deb-924d-2a6f51b4fb43 req-0289768f-fd4d-414f-978b-200968094813 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-changed-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-46fc56e6-1ada-4deb-924d-2a6f51b4fb43 req-0289768f-fd4d-414f-978b-200968094813 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Refreshing instance network info cache due to event network-changed-ddbc6964-8191-4483-8a63-2c853584be6f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-46fc56e6-1ada-4deb-924d-2a6f51b4fb43 req-0289768f-fd4d-414f-978b-200968094813 service nova] Acquiring lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Releasing lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Instance network_info: |[{"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-46fc56e6-1ada-4deb-924d-2a6f51b4fb43 req-0289768f-fd4d-414f-978b-200968094813 service nova] Acquired lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.neutron [req-46fc56e6-1ada-4deb-924d-2a6f51b4fb43 req-0289768f-fd4d-414f-978b-200968094813 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Refreshing network info cache for port ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Start _get_guest_xml network_info=[{"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:07:51 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:51 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-675565366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-675565366',id=7,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEO5dx++IX4ljOuW+qNj5hpC2x51PQ/SXgUWZY1ekvFYqfyCilmR4DC2lOZdcQco8cKcpkEKyVcg6SoQUuKw0WDM3TFiS+hwHnBjz0Ph4sNwOOd+murzzpvCJKAO0syDw==',key_name='tempest-keypair-1735451947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='884f75b337bf4ab5b239e3e1e16954ed',ramdisk_id='',reservation_id='r-6o10505b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-259044806',owner_user_name='tempest-TaggedAttachmentsTest-259044806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42bc78aefa2847238a3b25da59c9a148',uuid=2c672325-def3-49a9-a7b2-9dfb4fa0ce2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converting VIF {"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=ddbc6964-8191-4483-8a63-2c853584be6f,network=Network(28e57b0c-679d-49b9-9797-3a4e20e525f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbc6964-81') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.objects.instance [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:07:51 user nova-compute[74587]:   <uuid>2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</uuid>
Oct 18 07:07:51 user nova-compute[74587]:   <name>instance-00000007</name>
Oct 18 07:07:51 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:07:51 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:07:51 user nova-compute[74587]:   <metadata>
Oct 18 07:07:51 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:07:51 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:07:51 user nova-compute[74587]:       <nova:name>tempest-device-tagging-server-675565366</nova:name>
Oct 18 07:07:51 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:07:51</nova:creationTime>
Oct 18 07:07:51 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:07:51 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:07:51 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:07:51 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:07:51 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:07:51 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:07:51 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:07:51 user nova-compute[74587]:       <nova:owner>
Oct 18 07:07:51 user nova-compute[74587]:         <nova:user uuid="42bc78aefa2847238a3b25da59c9a148">tempest-TaggedAttachmentsTest-259044806-project-member</nova:user>
Oct 18 07:07:51 user nova-compute[74587]:         <nova:project uuid="884f75b337bf4ab5b239e3e1e16954ed">tempest-TaggedAttachmentsTest-259044806</nova:project>
Oct 18 07:07:51 user nova-compute[74587]:       </nova:owner>
Oct 18 07:07:51 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:07:51 user nova-compute[74587]:       <nova:ports>
Oct 18 07:07:51 user nova-compute[74587]:         <nova:port uuid="ddbc6964-8191-4483-8a63-2c853584be6f">
Oct 18 07:07:51 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 07:07:51 user nova-compute[74587]:         </nova:port>
Oct 18 07:07:51 user nova-compute[74587]:       </nova:ports>
Oct 18 07:07:51 user nova-compute[74587]:     </nova:instance>
Oct 18 07:07:51 user nova-compute[74587]:   </metadata>
Oct 18 07:07:51 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:07:51 user nova-compute[74587]:     <system>
Oct 18 07:07:51 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:07:51 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:07:51 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:07:51 user nova-compute[74587]:       <entry name="serial">2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</entry>
Oct 18 07:07:51 user nova-compute[74587]:       <entry name="uuid">2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</entry>
Oct 18 07:07:51 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:07:51 user nova-compute[74587]:     </system>
Oct 18 07:07:51 user nova-compute[74587]:   </sysinfo>
Oct 18 07:07:51 user nova-compute[74587]:   <os>
Oct 18 07:07:51 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:07:51 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:07:51 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:07:51 user nova-compute[74587]:   </os>
Oct 18 07:07:51 user nova-compute[74587]:   <features>
Oct 18 07:07:51 user nova-compute[74587]:     <acpi/>
Oct 18 07:07:51 user nova-compute[74587]:     <apic/>
Oct 18 07:07:51 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:07:51 user nova-compute[74587]:   </features>
Oct 18 07:07:51 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:07:51 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:07:51 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:07:51 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:07:51 user nova-compute[74587]:   </clock>
Oct 18 07:07:51 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:07:51 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:07:51 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:07:51 user nova-compute[74587]:   </cpu>
Oct 18 07:07:51 user nova-compute[74587]:   <devices>
Oct 18 07:07:51 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:07:51 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:07:51 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk"/>
Oct 18 07:07:51 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:07:51 user nova-compute[74587]:     </disk>
Oct 18 07:07:51 user nova-compute[74587]:     <disk type="file" device="cdrom">
Oct 18 07:07:51 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none"/>
Oct 18 07:07:51 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk.config"/>
Oct 18 07:07:51 user nova-compute[74587]:       <target dev="hda" bus="ide"/>
Oct 18 07:07:51 user nova-compute[74587]:     </disk>
Oct 18 07:07:51 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:07:51 user nova-compute[74587]:       <mac address="fa:16:3e:9c:6f:78"/>
Oct 18 07:07:51 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:51 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:07:51 user nova-compute[74587]:       <target dev="tapddbc6964-81"/>
Oct 18 07:07:51 user nova-compute[74587]:     </interface>
Oct 18 07:07:51 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:07:51 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/console.log" append="off"/>
Oct 18 07:07:51 user nova-compute[74587]:     </serial>
Oct 18 07:07:51 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:07:51 user nova-compute[74587]:     <video>
Oct 18 07:07:51 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:51 user nova-compute[74587]:     </video>
Oct 18 07:07:51 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:07:51 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:07:51 user nova-compute[74587]:     </rng>
Oct 18 07:07:51 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:07:51 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:07:51 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:07:51 user nova-compute[74587]:     </memballoon>
Oct 18 07:07:51 user nova-compute[74587]:   </devices>
Oct 18 07:07:51 user nova-compute[74587]: </domain>
Oct 18 07:07:51 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-675565366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-675565366',id=7,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEO5dx++IX4ljOuW+qNj5hpC2x51PQ/SXgUWZY1ekvFYqfyCilmR4DC2lOZdcQco8cKcpkEKyVcg6SoQUuKw0WDM3TFiS+hwHnBjz0Ph4sNwOOd+murzzpvCJKAO0syDw==',key_name='tempest-keypair-1735451947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='884f75b337bf4ab5b239e3e1e16954ed',ramdisk_id='',reservation_id='r-6o10505b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-259044806',owner_user_name='tempest-TaggedAttachmentsTest-259044806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42bc78aefa2847238a3b25da59c9a148',uuid=2c672325-def3-49a9-a7b2-9dfb4fa0ce2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converting VIF {"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=ddbc6964-8191-4483-8a63-2c853584be6f,network=Network(28e57b0c-679d-49b9-9797-3a4e20e525f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbc6964-81') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG os_vif [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=ddbc6964-8191-4483-8a63-2c853584be6f,network=Network(28e57b0c-679d-49b9-9797-3a4e20e525f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbc6964-81') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56b64773-076a-50f7-965a-fecb22e4a376', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddbc6964-81, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddbc6964-81, col_values=(('qos', UUID('e7f7c3fa-b095-4a5d-9ce8-7e7a5c63a1ae')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddbc6964-81, col_values=(('external_ids', {'iface-id': 'ddbc6964-8191-4483-8a63-2c853584be6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:6f:78', 'vm-uuid': '2c672325-def3-49a9-a7b2-9dfb4fa0ce2c'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:51 user nova-compute[74587]: INFO os_vif [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=ddbc6964-8191-4483-8a63-2c853584be6f,network=Network(28e57b0c-679d-49b9-9797-3a4e20e525f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbc6964-81')
Oct 18 07:07:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] No BDM found with device name hda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] No VIF found with MAC fa:16:3e:9c:6f:78, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:07:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Using config drive
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Successfully updated port: 0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "refresh_cache-205d8114-61a9-4108-9f65-042656ad2a69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquired lock "refresh_cache-205d8114-61a9-4108-9f65-042656ad2a69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-3c4bfae9-10b1-4a76-9987-751ed1e5c078 req-00dc3692-8754-4e5a-a817-1b7b531148ce service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received event network-changed-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-3c4bfae9-10b1-4a76-9987-751ed1e5c078 req-00dc3692-8754-4e5a-a817-1b7b531148ce service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Refreshing instance network info cache due to event network-changed-0d782334-b135-4c85-94f5-45c448d3256c. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3c4bfae9-10b1-4a76-9987-751ed1e5c078 req-00dc3692-8754-4e5a-a817-1b7b531148ce service nova] Acquiring lock "refresh_cache-205d8114-61a9-4108-9f65-042656ad2a69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.neutron [req-46fc56e6-1ada-4deb-924d-2a6f51b4fb43 req-0289768f-fd4d-414f-978b-200968094813 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updated VIF entry in instance network info cache for port ddbc6964-8191-4483-8a63-2c853584be6f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG nova.network.neutron [req-46fc56e6-1ada-4deb-924d-2a6f51b4fb43 req-0289768f-fd4d-414f-978b-200968094813 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updating instance_info_cache with network_info: [{"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Creating config drive at /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk.config
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppoqlyw1m {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-46fc56e6-1ada-4deb-924d-2a6f51b4fb43 req-0289768f-fd4d-414f-978b-200968094813 service nova] Releasing lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppoqlyw1m" returned: 0 in 0.056s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Updating instance_info_cache with network_info: [{"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Releasing lock "refresh_cache-205d8114-61a9-4108-9f65-042656ad2a69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Instance network_info: |[{"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3c4bfae9-10b1-4a76-9987-751ed1e5c078 req-00dc3692-8754-4e5a-a817-1b7b531148ce service nova] Acquired lock "refresh_cache-205d8114-61a9-4108-9f65-042656ad2a69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.network.neutron [req-3c4bfae9-10b1-4a76-9987-751ed1e5c078 req-00dc3692-8754-4e5a-a817-1b7b531148ce service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Refreshing network info cache for port 0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Start _get_guest_xml network_info=[{"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:07:52 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:52 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1414595523',display_name='tempest-TestVolumeSwap-server-1414595523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1414595523',id=8,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOD93BRu4BfvWIVxkN4tYPyBr48X0UyyR7krQVr3p719JxSGUPEhgbW0FhU5zHPS6GTaG2UhCCT+ZI9O6eaBgN40H+XZ6eXoy5/u9cVs2oIAT056YjTI1tHmF2ys3aJxw==',key_name='tempest-keypair-410090200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad5bfc6e6c3e4a31a776c8039fb68cdb',ramdisk_id='',reservation_id='r-o78w5439',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1036758189',owner_user_name='tempest-TestVolumeSwap-1036758189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e30aa1cbe46c4bf6a8a82e3c8adff031',uuid=205d8114-61a9-4108-9f65-042656ad2a69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Converting VIF {"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:59:28,bridge_name='br-int',has_traffic_filtering=True,id=0d782334-b135-4c85-94f5-45c448d3256c,network=Network(7e67c4af-793f-4669-a7e1-9a890f0a3d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d782334-b1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lazy-loading 'pci_devices' on Instance uuid 205d8114-61a9-4108-9f65-042656ad2a69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:07:52 user nova-compute[74587]:   <uuid>205d8114-61a9-4108-9f65-042656ad2a69</uuid>
Oct 18 07:07:52 user nova-compute[74587]:   <name>instance-00000008</name>
Oct 18 07:07:52 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:07:52 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:07:52 user nova-compute[74587]:   <metadata>
Oct 18 07:07:52 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:07:52 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:07:52 user nova-compute[74587]:       <nova:name>tempest-TestVolumeSwap-server-1414595523</nova:name>
Oct 18 07:07:52 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:07:52</nova:creationTime>
Oct 18 07:07:52 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:07:52 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:07:52 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:07:52 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:07:52 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:07:52 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:07:52 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:07:52 user nova-compute[74587]:       <nova:owner>
Oct 18 07:07:52 user nova-compute[74587]:         <nova:user uuid="e30aa1cbe46c4bf6a8a82e3c8adff031">tempest-TestVolumeSwap-1036758189-project-member</nova:user>
Oct 18 07:07:52 user nova-compute[74587]:         <nova:project uuid="ad5bfc6e6c3e4a31a776c8039fb68cdb">tempest-TestVolumeSwap-1036758189</nova:project>
Oct 18 07:07:52 user nova-compute[74587]:       </nova:owner>
Oct 18 07:07:52 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:07:52 user nova-compute[74587]:       <nova:ports>
Oct 18 07:07:52 user nova-compute[74587]:         <nova:port uuid="0d782334-b135-4c85-94f5-45c448d3256c">
Oct 18 07:07:52 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:07:52 user nova-compute[74587]:         </nova:port>
Oct 18 07:07:52 user nova-compute[74587]:       </nova:ports>
Oct 18 07:07:52 user nova-compute[74587]:     </nova:instance>
Oct 18 07:07:52 user nova-compute[74587]:   </metadata>
Oct 18 07:07:52 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:07:52 user nova-compute[74587]:     <system>
Oct 18 07:07:52 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:07:52 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:07:52 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:07:52 user nova-compute[74587]:       <entry name="serial">205d8114-61a9-4108-9f65-042656ad2a69</entry>
Oct 18 07:07:52 user nova-compute[74587]:       <entry name="uuid">205d8114-61a9-4108-9f65-042656ad2a69</entry>
Oct 18 07:07:52 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:07:52 user nova-compute[74587]:     </system>
Oct 18 07:07:52 user nova-compute[74587]:   </sysinfo>
Oct 18 07:07:52 user nova-compute[74587]:   <os>
Oct 18 07:07:52 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:07:52 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:07:52 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:07:52 user nova-compute[74587]:   </os>
Oct 18 07:07:52 user nova-compute[74587]:   <features>
Oct 18 07:07:52 user nova-compute[74587]:     <acpi/>
Oct 18 07:07:52 user nova-compute[74587]:     <apic/>
Oct 18 07:07:52 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:07:52 user nova-compute[74587]:   </features>
Oct 18 07:07:52 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:07:52 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:07:52 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:07:52 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:07:52 user nova-compute[74587]:   </clock>
Oct 18 07:07:52 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:07:52 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:07:52 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:07:52 user nova-compute[74587]:   </cpu>
Oct 18 07:07:52 user nova-compute[74587]:   <devices>
Oct 18 07:07:52 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:07:52 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:07:52 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk"/>
Oct 18 07:07:52 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:07:52 user nova-compute[74587]:     </disk>
Oct 18 07:07:52 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:07:52 user nova-compute[74587]:       <mac address="fa:16:3e:d2:59:28"/>
Oct 18 07:07:52 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:52 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:07:52 user nova-compute[74587]:       <target dev="tap0d782334-b1"/>
Oct 18 07:07:52 user nova-compute[74587]:     </interface>
Oct 18 07:07:52 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:07:52 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/console.log" append="off"/>
Oct 18 07:07:52 user nova-compute[74587]:     </serial>
Oct 18 07:07:52 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:07:52 user nova-compute[74587]:     <video>
Oct 18 07:07:52 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:07:52 user nova-compute[74587]:     </video>
Oct 18 07:07:52 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:07:52 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:07:52 user nova-compute[74587]:     </rng>
Oct 18 07:07:52 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:07:52 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:07:52 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:07:52 user nova-compute[74587]:     </memballoon>
Oct 18 07:07:52 user nova-compute[74587]:   </devices>
Oct 18 07:07:52 user nova-compute[74587]: </domain>
Oct 18 07:07:52 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1414595523',display_name='tempest-TestVolumeSwap-server-1414595523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1414595523',id=8,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOD93BRu4BfvWIVxkN4tYPyBr48X0UyyR7krQVr3p719JxSGUPEhgbW0FhU5zHPS6GTaG2UhCCT+ZI9O6eaBgN40H+XZ6eXoy5/u9cVs2oIAT056YjTI1tHmF2ys3aJxw==',key_name='tempest-keypair-410090200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad5bfc6e6c3e4a31a776c8039fb68cdb',ramdisk_id='',reservation_id='r-o78w5439',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1036758189',owner_user_name='tempest-TestVolumeSwap-1036758189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e30aa1cbe46c4bf6a8a82e3c8adff031',uuid=205d8114-61a9-4108-9f65-042656ad2a69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Converting VIF {"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:59:28,bridge_name='br-int',has_traffic_filtering=True,id=0d782334-b135-4c85-94f5-45c448d3256c,network=Network(7e67c4af-793f-4669-a7e1-9a890f0a3d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d782334-b1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG os_vif [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:59:28,bridge_name='br-int',has_traffic_filtering=True,id=0d782334-b135-4c85-94f5-45c448d3256c,network=Network(7e67c4af-793f-4669-a7e1-9a890f0a3d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d782334-b1') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e584d925-d972-5cd7-bd6e-69f71c4cbda8', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d782334-b1, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d782334-b1, col_values=(('qos', UUID('57bfffa2-6249-4916-bfb9-59c355b76af4')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d782334-b1, col_values=(('external_ids', {'iface-id': '0d782334-b135-4c85-94f5-45c448d3256c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:59:28', 'vm-uuid': '205d8114-61a9-4108-9f65-042656ad2a69'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:52 user nova-compute[74587]: INFO os_vif [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:59:28,bridge_name='br-int',has_traffic_filtering=True,id=0d782334-b135-4c85-94f5-45c448d3256c,network=Network(7e67c4af-793f-4669-a7e1-9a890f0a3d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d782334-b1')
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] No VIF found with MAC fa:16:3e:d2:59:28, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.network.neutron [req-3c4bfae9-10b1-4a76-9987-751ed1e5c078 req-00dc3692-8754-4e5a-a817-1b7b531148ce service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Updated VIF entry in instance network info cache for port 0d782334-b135-4c85-94f5-45c448d3256c. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG nova.network.neutron [req-3c4bfae9-10b1-4a76-9987-751ed1e5c078 req-00dc3692-8754-4e5a-a817-1b7b531148ce service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Updating instance_info_cache with network_info: [{"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:07:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3c4bfae9-10b1-4a76-9987-751ed1e5c078 req-00dc3692-8754-4e5a-a817-1b7b531148ce service nova] Releasing lock "refresh_cache-205d8114-61a9-4108-9f65-042656ad2a69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:07:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-37a70bdc-7792-4f1a-82cc-cea052fbf5a3 req-2e13d689-7930-4196-9e71-155dec53b663 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-37a70bdc-7792-4f1a-82cc-cea052fbf5a3 req-2e13d689-7930-4196-9e71-155dec53b663 service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-37a70bdc-7792-4f1a-82cc-cea052fbf5a3 req-2e13d689-7930-4196-9e71-155dec53b663 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-37a70bdc-7792-4f1a-82cc-cea052fbf5a3 req-2e13d689-7930-4196-9e71-155dec53b663 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-37a70bdc-7792-4f1a-82cc-cea052fbf5a3 req-2e13d689-7930-4196-9e71-155dec53b663 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:07:56 user nova-compute[74587]: WARNING nova.compute.manager [req-37a70bdc-7792-4f1a-82cc-cea052fbf5a3 req-2e13d689-7930-4196-9e71-155dec53b663 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state active and task_state None.
Oct 18 07:07:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Acquiring lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG nova.compute.manager [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:07:56 user nova-compute[74587]: INFO nova.compute.claims [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Claim successful on node user
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.775s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.network.neutron [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:07:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.policy [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26c1fb8d1cfb44228dfa8a26efd27bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f5692171db4aed9cbee623607ec665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:07:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Creating image(s)
Oct 18 07:07:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "/opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "/opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:07:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Instance spawned successfully.
Oct 18 07:07:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.209s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:07:58 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Instance spawned successfully.
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:07:58 user nova-compute[74587]: INFO nova.compute.manager [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Took 8.12 seconds to spawn the instance on the hypervisor.
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-0884ef18-8435-430c-8918-2b5fd7dcc7e3 req-dfbb97e9-6493-497e-913c-244eb1f72a32 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0884ef18-8435-430c-8918-2b5fd7dcc7e3 req-dfbb97e9-6493-497e-913c-244eb1f72a32 service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0884ef18-8435-430c-8918-2b5fd7dcc7e3 req-dfbb97e9-6493-497e-913c-244eb1f72a32 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0884ef18-8435-430c-8918-2b5fd7dcc7e3 req-dfbb97e9-6493-497e-913c-244eb1f72a32 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-0884ef18-8435-430c-8918-2b5fd7dcc7e3 req-dfbb97e9-6493-497e-913c-244eb1f72a32 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:07:58 user nova-compute[74587]: WARNING nova.compute.manager [req-0884ef18-8435-430c-8918-2b5fd7dcc7e3 req-dfbb97e9-6493-497e-913c-244eb1f72a32 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state active and task_state None.
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk 1073741824" returned: 0 in 0.073s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Successfully created port: c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:07:58 user nova-compute[74587]: INFO nova.compute.manager [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Took 9.42 seconds to build instance.
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8732408-5fb4-49e2-8d28-59d2b8f3c3ad tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.756s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:58 user nova-compute[74587]: INFO nova.compute.manager [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Took 10.21 seconds to spawn the instance on the hypervisor.
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.354s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:07:58 user nova-compute[74587]: INFO nova.compute.manager [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Took 11.75 seconds to build instance.
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Cannot resize image /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Ensure instance console log exists: /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1ec6c652-728a-4402-94ac-a3b63891c640 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.998s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-d7de028a-21ee-424a-828b-b102c7773749 req-e8bece01-f093-4e70-ae11-091fd69a3c4f service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received event network-vif-plugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:07:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7de028a-21ee-424a-828b-b102c7773749 req-e8bece01-f093-4e70-ae11-091fd69a3c4f service nova] Acquiring lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:07:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7de028a-21ee-424a-828b-b102c7773749 req-e8bece01-f093-4e70-ae11-091fd69a3c4f service nova] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:07:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7de028a-21ee-424a-828b-b102c7773749 req-e8bece01-f093-4e70-ae11-091fd69a3c4f service nova] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.014s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:07:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-d7de028a-21ee-424a-828b-b102c7773749 req-e8bece01-f093-4e70-ae11-091fd69a3c4f service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] No waiting events found dispatching network-vif-plugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:07:59 user nova-compute[74587]: WARNING nova.compute.manager [req-d7de028a-21ee-424a-828b-b102c7773749 req-e8bece01-f093-4e70-ae11-091fd69a3c4f service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received unexpected event network-vif-plugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e for instance with vm_state active and task_state None.
Oct 18 07:07:59 user nova-compute[74587]: DEBUG nova.network.neutron [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Successfully updated port: c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:07:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Acquiring lock "refresh_cache-fe0bd998-4fb1-45fc-a2c3-c3486c54754d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:07:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Acquired lock "refresh_cache-fe0bd998-4fb1-45fc-a2c3-c3486c54754d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:07:59 user nova-compute[74587]: DEBUG nova.network.neutron [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-abc99369-8e2c-4b64-bb36-6eaa57ce4041 req-0e4f5b7d-96a5-49c5-a09d-15f07b6a1bc9 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received event network-changed-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-abc99369-8e2c-4b64-bb36-6eaa57ce4041 req-0e4f5b7d-96a5-49c5-a09d-15f07b6a1bc9 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Refreshing instance network info cache due to event network-changed-c050b165-f76e-484d-a030-09f32640e911. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-abc99369-8e2c-4b64-bb36-6eaa57ce4041 req-0e4f5b7d-96a5-49c5-a09d-15f07b6a1bc9 service nova] Acquiring lock "refresh_cache-fe0bd998-4fb1-45fc-a2c3-c3486c54754d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Updating instance_info_cache with network_info: [{"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Releasing lock "refresh_cache-fe0bd998-4fb1-45fc-a2c3-c3486c54754d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Instance network_info: |[{"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-abc99369-8e2c-4b64-bb36-6eaa57ce4041 req-0e4f5b7d-96a5-49c5-a09d-15f07b6a1bc9 service nova] Acquired lock "refresh_cache-fe0bd998-4fb1-45fc-a2c3-c3486c54754d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.network.neutron [req-abc99369-8e2c-4b64-bb36-6eaa57ce4041 req-0e4f5b7d-96a5-49c5-a09d-15f07b6a1bc9 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Refreshing network info cache for port c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Start _get_guest_xml network_info=[{"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:08:00 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:08:00 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1426431396',display_name='tempest-VolumesAssistedSnapshotsTest-server-1426431396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1426431396',id=9,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Vw5HV6E3TkbC4pqqyGnZv30BM/nrSMxLYgbMIpeg49vo+/sBUx7GIpjirtDHrd5FFPfjoma7xT2H+r0DrfBu1V1YeExG1nY3iBjdBygLK2nCqusGNVSHhQKcnejaFNg==',key_name='tempest-keypair-116029123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21f5692171db4aed9cbee623607ec665',ramdisk_id='',reservation_id='r-gic31dbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-551656722',owner_user_name='tempest-VolumesAssistedSnapshotsTest-551656722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26c1fb8d1cfb44228dfa8a26efd27bc6',uuid=fe0bd998-4fb1-45fc-a2c3-c3486c54754d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Converting VIF {"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:72:85,bridge_name='br-int',has_traffic_filtering=True,id=c050b165-f76e-484d-a030-09f32640e911,network=Network(bbdefb28-8928-4c79-9272-25b05020c4ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc050b165-f7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lazy-loading 'pci_devices' on Instance uuid fe0bd998-4fb1-45fc-a2c3-c3486c54754d {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:08:00 user nova-compute[74587]:   <uuid>fe0bd998-4fb1-45fc-a2c3-c3486c54754d</uuid>
Oct 18 07:08:00 user nova-compute[74587]:   <name>instance-00000009</name>
Oct 18 07:08:00 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:08:00 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:08:00 user nova-compute[74587]:   <metadata>
Oct 18 07:08:00 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:08:00 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:08:00 user nova-compute[74587]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1426431396</nova:name>
Oct 18 07:08:00 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:08:00</nova:creationTime>
Oct 18 07:08:00 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:08:00 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:08:00 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:08:00 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:08:00 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:08:00 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:08:00 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:08:00 user nova-compute[74587]:       <nova:owner>
Oct 18 07:08:00 user nova-compute[74587]:         <nova:user uuid="26c1fb8d1cfb44228dfa8a26efd27bc6">tempest-VolumesAssistedSnapshotsTest-551656722-project-member</nova:user>
Oct 18 07:08:00 user nova-compute[74587]:         <nova:project uuid="21f5692171db4aed9cbee623607ec665">tempest-VolumesAssistedSnapshotsTest-551656722</nova:project>
Oct 18 07:08:00 user nova-compute[74587]:       </nova:owner>
Oct 18 07:08:00 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:08:00 user nova-compute[74587]:       <nova:ports>
Oct 18 07:08:00 user nova-compute[74587]:         <nova:port uuid="c050b165-f76e-484d-a030-09f32640e911">
Oct 18 07:08:00 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 07:08:00 user nova-compute[74587]:         </nova:port>
Oct 18 07:08:00 user nova-compute[74587]:       </nova:ports>
Oct 18 07:08:00 user nova-compute[74587]:     </nova:instance>
Oct 18 07:08:00 user nova-compute[74587]:   </metadata>
Oct 18 07:08:00 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:08:00 user nova-compute[74587]:     <system>
Oct 18 07:08:00 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:08:00 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:08:00 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:08:00 user nova-compute[74587]:       <entry name="serial">fe0bd998-4fb1-45fc-a2c3-c3486c54754d</entry>
Oct 18 07:08:00 user nova-compute[74587]:       <entry name="uuid">fe0bd998-4fb1-45fc-a2c3-c3486c54754d</entry>
Oct 18 07:08:00 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:08:00 user nova-compute[74587]:     </system>
Oct 18 07:08:00 user nova-compute[74587]:   </sysinfo>
Oct 18 07:08:00 user nova-compute[74587]:   <os>
Oct 18 07:08:00 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:08:00 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:08:00 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:08:00 user nova-compute[74587]:   </os>
Oct 18 07:08:00 user nova-compute[74587]:   <features>
Oct 18 07:08:00 user nova-compute[74587]:     <acpi/>
Oct 18 07:08:00 user nova-compute[74587]:     <apic/>
Oct 18 07:08:00 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:08:00 user nova-compute[74587]:   </features>
Oct 18 07:08:00 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:08:00 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:08:00 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:08:00 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:08:00 user nova-compute[74587]:   </clock>
Oct 18 07:08:00 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:08:00 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:08:00 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:08:00 user nova-compute[74587]:   </cpu>
Oct 18 07:08:00 user nova-compute[74587]:   <devices>
Oct 18 07:08:00 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:08:00 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:08:00 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk"/>
Oct 18 07:08:00 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:08:00 user nova-compute[74587]:     </disk>
Oct 18 07:08:00 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:08:00 user nova-compute[74587]:       <mac address="fa:16:3e:5e:72:85"/>
Oct 18 07:08:00 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:08:00 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:08:00 user nova-compute[74587]:       <target dev="tapc050b165-f7"/>
Oct 18 07:08:00 user nova-compute[74587]:     </interface>
Oct 18 07:08:00 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:08:00 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/console.log" append="off"/>
Oct 18 07:08:00 user nova-compute[74587]:     </serial>
Oct 18 07:08:00 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:08:00 user nova-compute[74587]:     <video>
Oct 18 07:08:00 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:08:00 user nova-compute[74587]:     </video>
Oct 18 07:08:00 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:08:00 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:08:00 user nova-compute[74587]:     </rng>
Oct 18 07:08:00 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:08:00 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:08:00 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:08:00 user nova-compute[74587]:     </memballoon>
Oct 18 07:08:00 user nova-compute[74587]:   </devices>
Oct 18 07:08:00 user nova-compute[74587]: </domain>
Oct 18 07:08:00 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1426431396',display_name='tempest-VolumesAssistedSnapshotsTest-server-1426431396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1426431396',id=9,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Vw5HV6E3TkbC4pqqyGnZv30BM/nrSMxLYgbMIpeg49vo+/sBUx7GIpjirtDHrd5FFPfjoma7xT2H+r0DrfBu1V1YeExG1nY3iBjdBygLK2nCqusGNVSHhQKcnejaFNg==',key_name='tempest-keypair-116029123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21f5692171db4aed9cbee623607ec665',ramdisk_id='',reservation_id='r-gic31dbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-551656722',owner_user_name='tempest-VolumesAssistedSnapshotsTest-551656722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26c1fb8d1cfb44228dfa8a26efd27bc6',uuid=fe0bd998-4fb1-45fc-a2c3-c3486c54754d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Converting VIF {"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:72:85,bridge_name='br-int',has_traffic_filtering=True,id=c050b165-f76e-484d-a030-09f32640e911,network=Network(bbdefb28-8928-4c79-9272-25b05020c4ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc050b165-f7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG os_vif [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:72:85,bridge_name='br-int',has_traffic_filtering=True,id=c050b165-f76e-484d-a030-09f32640e911,network=Network(bbdefb28-8928-4c79-9272-25b05020c4ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc050b165-f7') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c0c420e-a4fb-57c8-af71-2a2c6241d938', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc050b165-f7, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc050b165-f7, col_values=(('qos', UUID('701a55bc-98b2-44a9-9186-5ce8b934c9c9')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc050b165-f7, col_values=(('external_ids', {'iface-id': 'c050b165-f76e-484d-a030-09f32640e911', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:72:85', 'vm-uuid': 'fe0bd998-4fb1-45fc-a2c3-c3486c54754d'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:00 user nova-compute[74587]: INFO os_vif [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:72:85,bridge_name='br-int',has_traffic_filtering=True,id=c050b165-f76e-484d-a030-09f32640e911,network=Network(bbdefb28-8928-4c79-9272-25b05020c4ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc050b165-f7')
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] No VIF found with MAC fa:16:3e:5e:72:85, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:01 user nova-compute[74587]: DEBUG nova.network.neutron [req-abc99369-8e2c-4b64-bb36-6eaa57ce4041 req-0e4f5b7d-96a5-49c5-a09d-15f07b6a1bc9 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Updated VIF entry in instance network info cache for port c050b165-f76e-484d-a030-09f32640e911. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:08:01 user nova-compute[74587]: DEBUG nova.network.neutron [req-abc99369-8e2c-4b64-bb36-6eaa57ce4041 req-0e4f5b7d-96a5-49c5-a09d-15f07b6a1bc9 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Updating instance_info_cache with network_info: [{"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:08:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-abc99369-8e2c-4b64-bb36-6eaa57ce4041 req-0e4f5b7d-96a5-49c5-a09d-15f07b6a1bc9 service nova] Releasing lock "refresh_cache-fe0bd998-4fb1-45fc-a2c3-c3486c54754d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:08:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-ea3957d0-b961-4951-a700-af6db2bb6de8 req-92dfefe8-cac0-4f31-8a99-a3d234a28383 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received event network-vif-plugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ea3957d0-b961-4951-a700-af6db2bb6de8 req-92dfefe8-cac0-4f31-8a99-a3d234a28383 service nova] Acquiring lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ea3957d0-b961-4951-a700-af6db2bb6de8 req-92dfefe8-cac0-4f31-8a99-a3d234a28383 service nova] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ea3957d0-b961-4951-a700-af6db2bb6de8 req-92dfefe8-cac0-4f31-8a99-a3d234a28383 service nova] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-ea3957d0-b961-4951-a700-af6db2bb6de8 req-92dfefe8-cac0-4f31-8a99-a3d234a28383 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] No waiting events found dispatching network-vif-plugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:08:01 user nova-compute[74587]: WARNING nova.compute.manager [req-ea3957d0-b961-4951-a700-af6db2bb6de8 req-92dfefe8-cac0-4f31-8a99-a3d234a28383 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received unexpected event network-vif-plugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e for instance with vm_state active and task_state None.
Oct 18 07:08:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:08:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Skipping network cache update for instance because it is Building. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:08:03 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:08:04 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updating instance_info_cache with network_info: [{"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:08:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:08:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:08:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG nova.compute.manager [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:08:05 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Instance spawned successfully.
Oct 18 07:08:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:08:05 user nova-compute[74587]: INFO nova.compute.manager [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Took 7.80 seconds to spawn the instance on the hypervisor.
Oct 18 07:08:05 user nova-compute[74587]: DEBUG nova.compute.manager [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:05 user nova-compute[74587]: INFO nova.compute.manager [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Took 9.14 seconds to build instance.
Oct 18 07:08:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-190c609e-45b2-43af-9d4c-2e2f0c130347 tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.293s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-75ab53d4-e787-4eb6-962f-b11363e3138a req-7cc6663d-c3d8-4db7-aa4d-de504a9c48c0 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received event network-vif-plugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-75ab53d4-e787-4eb6-962f-b11363e3138a req-7cc6663d-c3d8-4db7-aa4d-de504a9c48c0 service nova] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-75ab53d4-e787-4eb6-962f-b11363e3138a req-7cc6663d-c3d8-4db7-aa4d-de504a9c48c0 service nova] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-75ab53d4-e787-4eb6-962f-b11363e3138a req-7cc6663d-c3d8-4db7-aa4d-de504a9c48c0 service nova] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-75ab53d4-e787-4eb6-962f-b11363e3138a req-7cc6663d-c3d8-4db7-aa4d-de504a9c48c0 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] No waiting events found dispatching network-vif-plugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:08:06 user nova-compute[74587]: WARNING nova.compute.manager [req-75ab53d4-e787-4eb6-962f-b11363e3138a req-7cc6663d-c3d8-4db7-aa4d-de504a9c48c0 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received unexpected event network-vif-plugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 for instance with vm_state active and task_state None.
Oct 18 07:08:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received event network-vif-plugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] No waiting events found dispatching network-vif-plugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:08:09 user nova-compute[74587]: WARNING nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received unexpected event network-vif-plugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 for instance with vm_state active and task_state None.
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-plugged-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] No waiting events found dispatching network-vif-plugged-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:08:09 user nova-compute[74587]: WARNING nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received unexpected event network-vif-plugged-ddbc6964-8191-4483-8a63-2c853584be6f for instance with vm_state active and task_state None.
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-plugged-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] No waiting events found dispatching network-vif-plugged-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:08:09 user nova-compute[74587]: WARNING nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received unexpected event network-vif-plugged-ddbc6964-8191-4483-8a63-2c853584be6f for instance with vm_state active and task_state None.
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received event network-vif-plugged-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "205d8114-61a9-4108-9f65-042656ad2a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "205d8114-61a9-4108-9f65-042656ad2a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] No waiting events found dispatching network-vif-plugged-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:08:09 user nova-compute[74587]: WARNING nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received unexpected event network-vif-plugged-0d782334-b135-4c85-94f5-45c448d3256c for instance with vm_state active and task_state None.
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received event network-vif-plugged-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "205d8114-61a9-4108-9f65-042656ad2a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "205d8114-61a9-4108-9f65-042656ad2a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] No waiting events found dispatching network-vif-plugged-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:08:09 user nova-compute[74587]: WARNING nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received unexpected event network-vif-plugged-0d782334-b135-4c85-94f5-45c448d3256c for instance with vm_state active and task_state None.
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received event network-vif-plugged-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Acquiring lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] No waiting events found dispatching network-vif-plugged-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:08:09 user nova-compute[74587]: WARNING nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received unexpected event network-vif-plugged-c050b165-f76e-484d-a030-09f32640e911 for instance with vm_state active and task_state None.
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received event network-vif-plugged-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Acquiring lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] No waiting events found dispatching network-vif-plugged-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:08:09 user nova-compute[74587]: WARNING nova.compute.manager [req-ee7ef42c-000d-456d-8294-39ae7a33c4ef req-13893450-2980-44c2-be8d-91da6c4abe47 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received unexpected event network-vif-plugged-c050b165-f76e-484d-a030-09f32640e911 for instance with vm_state active and task_state None.
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:11 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:08:11 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:08:11 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7474MB free_disk=25.661643981933594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:08:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 4ef9e718-1203-413a-909f-b0cf90a5b2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 205d8114-61a9-4108-9f65-042656ad2a69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:08:12 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:08:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:08:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.546s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:15 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:08:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:08:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:08:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:08:49 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:08:49 user nova-compute[74587]: INFO nova.compute.claims [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Claim successful on node user
Oct 18 07:08:50 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:08:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:08:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:08:50 user nova-compute[74587]: INFO nova.virt.block_device [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Booting with volume 60d52911-fe77-4279-ac00-17cf830c6e12 at /dev/vda
Oct 18 07:08:50 user nova-compute[74587]: DEBUG nova.policy [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b827f4df3f55456793830f04cd97c728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03b70b00e5240b19b472ca694a97c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:08:50 user nova-compute[74587]: DEBUG os_brick.utils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:08:50 user nova-compute[74587]: INFO oslo.privsep.daemon [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpn9aquhrf/privsep.sock']
Oct 18 07:08:50 user sudo[85798]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpn9aquhrf/privsep.sock
Oct 18 07:08:50 user sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 18 07:08:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully created port: 73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:08:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully created port: afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:08:52 user sudo[85798]: pam_unix(sudo:session): session closed for user root
Oct 18 07:08:52 user nova-compute[74587]: INFO oslo.privsep.daemon [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Spawned new privsep daemon via rootwrap
Oct 18 07:08:52 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 18 07:08:52 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 18 07:08:52 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 18 07:08:52 user nova-compute[74587]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85802
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8981d41-a3fa-4cdb-922f-0561d9f9f75e]: (2,) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully created port: 88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d94a2f-e032-4a1f-b88a-1d7e91c0a7f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:08:52 user nova-compute[74587]: WARNING os_brick.initiator.connectors.nvmeof [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[020caffb-dd04-4d83-a3d9-d9585b07c196]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a047bcf5-27fb-4795-8389-3a2f9e63e211]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67de941-0d58-4ea5-b132-9d321778b493]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:08:52 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:08:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b48a94-1bb4-46fe-8db6-9c54131dee6b]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG os_brick.utils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] <== get_connector_properties: return (1861ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:08:52 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating existing volume attachment record: 4d7c59a9-a63b-4a60-83bd-9f6039dc8208 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:08:53 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully created port: 6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:08:53 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully created port: f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:08:54 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully updated port: 73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:08:54 user nova-compute[74587]: DEBUG nova.compute.manager [req-ac4b899b-9b44-44db-9728-5f94b1ef921e req-c7cb1808-d943-4c93-9c14-1af4c1a440af service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-changed-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:54 user nova-compute[74587]: DEBUG nova.compute.manager [req-ac4b899b-9b44-44db-9728-5f94b1ef921e req-c7cb1808-d943-4c93-9c14-1af4c1a440af service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing instance network info cache due to event network-changed-73afc3a4-da0c-42ea-b866-75dc761137d8. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:08:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ac4b899b-9b44-44db-9728-5f94b1ef921e req-c7cb1808-d943-4c93-9c14-1af4c1a440af service nova] Acquiring lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:08:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ac4b899b-9b44-44db-9728-5f94b1ef921e req-c7cb1808-d943-4c93-9c14-1af4c1a440af service nova] Acquired lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:08:54 user nova-compute[74587]: DEBUG nova.network.neutron [req-ac4b899b-9b44-44db-9728-5f94b1ef921e req-c7cb1808-d943-4c93-9c14-1af4c1a440af service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing network info cache for port 73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:08:54 user nova-compute[74587]: DEBUG nova.network.neutron [req-ac4b899b-9b44-44db-9728-5f94b1ef921e req-c7cb1808-d943-4c93-9c14-1af4c1a440af service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:08:55 user nova-compute[74587]: DEBUG nova.network.neutron [req-ac4b899b-9b44-44db-9728-5f94b1ef921e req-c7cb1808-d943-4c93-9c14-1af4c1a440af service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:08:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ac4b899b-9b44-44db-9728-5f94b1ef921e req-c7cb1808-d943-4c93-9c14-1af4c1a440af service nova] Releasing lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:08:55 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully updated port: 534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:08:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:08:56 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully updated port: 33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:08:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-changed-534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing instance network info cache due to event network-changed-534bce4c-d08f-4662-978c-432d52603ecf. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:08:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] Acquiring lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:08:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] Acquired lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:08:56 user nova-compute[74587]: DEBUG nova.network.neutron [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing network info cache for port 534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:08:56 user nova-compute[74587]: DEBUG nova.network.neutron [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG nova.network.neutron [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] Releasing lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG nova.compute.manager [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-changed-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG nova.compute.manager [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing instance network info cache due to event network-changed-33ce7796-efa3-4c97-8009-0b2ffb3d18a5. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] Acquiring lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] Acquired lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG nova.network.neutron [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing network info cache for port 33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully updated port: afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG nova.network.neutron [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG nova.network.neutron [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:08:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-10394258-4b97-436d-a8d7-b8e394a441b9 req-801f0fbd-2566-427d-8e48-317be1acac89 service nova] Releasing lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:08:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully updated port: 88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:08:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-changed-afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing instance network info cache due to event network-changed-afff56e2-e738-461d-8d5b-92152ceb057b. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:08:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] Acquiring lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:08:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] Acquired lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:08:58 user nova-compute[74587]: DEBUG nova.network.neutron [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing network info cache for port afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:08:58 user nova-compute[74587]: DEBUG nova.network.neutron [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:08:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully updated port: 6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG nova.network.neutron [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] Releasing lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-changed-88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing instance network info cache due to event network-changed-88116839-4d5e-45d4-98bb-f5ed9d0283d7. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] Acquiring lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] Acquired lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG nova.network.neutron [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing network info cache for port 88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG nova.network.neutron [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:08:59 user nova-compute[74587]: INFO nova.compute.manager [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Rescuing
Oct 18 07:08:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquired lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG nova.network.neutron [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG nova.network.neutron [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:08:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-75a3fa4d-1c97-4a76-82c5-8ec0c79fcefb req-228efe99-7044-4f09-8167-64fa63c53ade service nova] Releasing lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Successfully updated port: f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquired lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updating instance_info_cache with network_info: [{"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Releasing lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-b640b735-760c-4d11-8b2c-68965c94c105 req-2c7b252b-8f5e-4201-a133-3846f767a4cd service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-vif-unplugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b640b735-760c-4d11-8b2c-68965c94c105 req-2c7b252b-8f5e-4201-a133-3846f767a4cd service nova] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b640b735-760c-4d11-8b2c-68965c94c105 req-2c7b252b-8f5e-4201-a133-3846f767a4cd service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b640b735-760c-4d11-8b2c-68965c94c105 req-2c7b252b-8f5e-4201-a133-3846f767a4cd service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-b640b735-760c-4d11-8b2c-68965c94c105 req-2c7b252b-8f5e-4201-a133-3846f767a4cd service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] No waiting events found dispatching network-vif-unplugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:09:00 user nova-compute[74587]: WARNING nova.compute.manager [req-b640b735-760c-4d11-8b2c-68965c94c105 req-2c7b252b-8f5e-4201-a133-3846f767a4cd service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received unexpected event network-vif-unplugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 for instance with vm_state active and task_state rescuing.
Oct 18 07:09:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-changed-6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing instance network info cache due to event network-changed-6827f9e4-a725-4c88-8fa8-fc0d65263808. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] Acquiring lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:01 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Instance destroyed successfully.
Oct 18 07:09:01 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Attempting rescue
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74587) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Instance directory exists: not creating {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 07:09:01 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Creating image(s)
Oct 18 07:09:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.instance [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'trusted_certs' on Instance uuid d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue" returned: 0 in 0.055s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.instance [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'migration_context' on Instance uuid d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.base [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Start _get_guest_xml network_info=[{"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "vif_mac": "fa:16:3e:f6:c0:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.instance [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'resources' on Instance uuid d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.base [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.instance [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'numa_topology' on Instance uuid d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.base [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:09:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:09:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.instance [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'vcpu_model' on Instance uuid d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.base [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1979991676',display_name='tempest-ServerRescueNegativeTestJSON-server-1979991676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1979991676',id=2,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-aumf0bef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:30Z,user_data=None,user_id='96efd41052434514aea7fe47a5eb36f7',uuid=d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "vif_mac": "fa:16:3e:f6:c0:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "vif_mac": "fa:16:3e:f6:c0:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c0:14,bridge_name='br-int',has_traffic_filtering=True,id=da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f50ec-04') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.instance [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'pci_devices' on Instance uuid d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.objects.base [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:09:01 user nova-compute[74587]:   <uuid>d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7</uuid>
Oct 18 07:09:01 user nova-compute[74587]:   <name>instance-00000002</name>
Oct 18 07:09:01 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:09:01 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:09:01 user nova-compute[74587]:   <metadata>
Oct 18 07:09:01 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:09:01 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:09:01 user nova-compute[74587]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1979991676</nova:name>
Oct 18 07:09:01 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:09:01</nova:creationTime>
Oct 18 07:09:01 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:09:01 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:09:01 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:09:01 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:09:01 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:09:01 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:09:01 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:09:01 user nova-compute[74587]:       <nova:owner>
Oct 18 07:09:01 user nova-compute[74587]:         <nova:user uuid="96efd41052434514aea7fe47a5eb36f7">tempest-ServerRescueNegativeTestJSON-1222499333-project-member</nova:user>
Oct 18 07:09:01 user nova-compute[74587]:         <nova:project uuid="1b1dbea9d8d34471b74b5c002f5905f0">tempest-ServerRescueNegativeTestJSON-1222499333</nova:project>
Oct 18 07:09:01 user nova-compute[74587]:       </nova:owner>
Oct 18 07:09:01 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:09:01 user nova-compute[74587]:       <nova:ports>
Oct 18 07:09:01 user nova-compute[74587]:         <nova:port uuid="da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0">
Oct 18 07:09:01 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 18 07:09:01 user nova-compute[74587]:         </nova:port>
Oct 18 07:09:01 user nova-compute[74587]:       </nova:ports>
Oct 18 07:09:01 user nova-compute[74587]:     </nova:instance>
Oct 18 07:09:01 user nova-compute[74587]:   </metadata>
Oct 18 07:09:01 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:09:01 user nova-compute[74587]:     <system>
Oct 18 07:09:01 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:09:01 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:09:01 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:09:01 user nova-compute[74587]:       <entry name="serial">d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7</entry>
Oct 18 07:09:01 user nova-compute[74587]:       <entry name="uuid">d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7</entry>
Oct 18 07:09:01 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:09:01 user nova-compute[74587]:     </system>
Oct 18 07:09:01 user nova-compute[74587]:   </sysinfo>
Oct 18 07:09:01 user nova-compute[74587]:   <os>
Oct 18 07:09:01 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:09:01 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:09:01 user nova-compute[74587]:   </os>
Oct 18 07:09:01 user nova-compute[74587]:   <features>
Oct 18 07:09:01 user nova-compute[74587]:     <acpi/>
Oct 18 07:09:01 user nova-compute[74587]:     <apic/>
Oct 18 07:09:01 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:09:01 user nova-compute[74587]:   </features>
Oct 18 07:09:01 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:09:01 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:09:01 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:09:01 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:09:01 user nova-compute[74587]:   </clock>
Oct 18 07:09:01 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:09:01 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:09:01 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:09:01 user nova-compute[74587]:   </cpu>
Oct 18 07:09:01 user nova-compute[74587]:   <devices>
Oct 18 07:09:01 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:09:01 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:09:01 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue"/>
Oct 18 07:09:01 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:09:01 user nova-compute[74587]:     </disk>
Oct 18 07:09:01 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:09:01 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:09:01 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk"/>
Oct 18 07:09:01 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:09:01 user nova-compute[74587]:     </disk>
Oct 18 07:09:01 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:09:01 user nova-compute[74587]:       <mac address="fa:16:3e:f6:c0:14"/>
Oct 18 07:09:01 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:09:01 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:09:01 user nova-compute[74587]:       <target dev="tapda3f50ec-04"/>
Oct 18 07:09:01 user nova-compute[74587]:     </interface>
Oct 18 07:09:01 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:09:01 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/console.log" append="off"/>
Oct 18 07:09:01 user nova-compute[74587]:     </serial>
Oct 18 07:09:01 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:09:01 user nova-compute[74587]:     <video>
Oct 18 07:09:01 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:09:01 user nova-compute[74587]:     </video>
Oct 18 07:09:01 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:09:01 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:09:01 user nova-compute[74587]:     </rng>
Oct 18 07:09:01 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:09:01 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:09:01 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:09:01 user nova-compute[74587]:     </memballoon>
Oct 18 07:09:01 user nova-compute[74587]:   </devices>
Oct 18 07:09:01 user nova-compute[74587]: </domain>
Oct 18 07:09:01 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:09:01 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Instance destroyed successfully.
Oct 18 07:09:01 user nova-compute[74587]: INFO nova.compute.manager [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] instance snapshotting
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:09:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No VIF found with MAC fa:16:3e:f6:c0:14, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:09:01 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Beginning live snapshot process
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json -f qcow2 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json -f qcow2 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.165s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuzvuzm41/be2ada77db7341a2ab1661e6973d0d7e.delta 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [{"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuzvuzm41/be2ada77db7341a2ab1661e6973d0d7e.delta 1073741824" returned: 0 in 0.061s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:02 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 18 07:09:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74587) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 18 07:09:02 user nova-compute[74587]: INFO nova.virt.libvirt.host [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] UEFI support detected
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Releasing lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Instance network_info: |[{"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] Acquired lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing network info cache for port 6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-9b0e7434-cf32-4430-b40d-ed3995953516 req-4f6f3983-760d-46a2-80f2-0a8c638ef661 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9b0e7434-cf32-4430-b40d-ed3995953516 req-4f6f3983-760d-46a2-80f2-0a8c638ef661 service nova] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9b0e7434-cf32-4430-b40d-ed3995953516 req-4f6f3983-760d-46a2-80f2-0a8c638ef661 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9b0e7434-cf32-4430-b40d-ed3995953516 req-4f6f3983-760d-46a2-80f2-0a8c638ef661 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-9b0e7434-cf32-4430-b40d-ed3995953516 req-4f6f3983-760d-46a2-80f2-0a8c638ef661 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] No waiting events found dispatching network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:09:02 user nova-compute[74587]: WARNING nova.compute.manager [req-9b0e7434-cf32-4430-b40d-ed3995953516 req-4f6f3983-760d-46a2-80f2-0a8c638ef661 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received unexpected event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 for instance with vm_state active and task_state rescuing.
Oct 18 07:09:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG nova.network.neutron [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updated VIF entry in instance network info cache for port 6827f9e4-a725-4c88-8fa8-fc0d65263808. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG nova.network.neutron [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [{"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] Releasing lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-changed-f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing instance network info cache due to event network-changed-f55af884-f2ba-40ec-a51c-493e0f2d8c5f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] Acquiring lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] Acquired lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG nova.network.neutron [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing network info cache for port f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.network.neutron [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updated VIF entry in instance network info cache for port f55af884-f2ba-40ec-a51c-493e0f2d8c5f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.network.neutron [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [{"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:09:04 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcf5993a-8e1c-4861-8783-c4594cb48f1e req-f552befd-9104-478d-a529-846ad4ec0231 service nova] Releasing lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuzvuzm41/be2ada77db7341a2ab1661e6973d0d7e.delta /opt/stack/data/nova/instances/snapshots/tmpuzvuzm41/be2ada77db7341a2ab1661e6973d0d7e {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updating instance_info_cache with network_info: [{"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuzvuzm41/be2ada77db7341a2ab1661e6973d0d7e.delta /opt/stack/data/nova/instances/snapshots/tmpuzvuzm41/be2ada77db7341a2ab1661e6973d0d7e" returned: 0 in 0.484s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:04 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Snapshot extracted, beginning image upload
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] No waiting events found dispatching network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:09:04 user nova-compute[74587]: WARNING nova.compute.manager [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received unexpected event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 for instance with vm_state active and task_state rescuing.
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] No waiting events found dispatching network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:09:04 user nova-compute[74587]: WARNING nova.compute.manager [req-dbb98dac-b3cd-4770-9bfb-3ba2df956d6f req-97b42294-70d3-420f-bb17-8f9e67c6d361 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received unexpected event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 for instance with vm_state active and task_state rescuing.
Oct 18 07:09:05 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:09:05 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:09:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:05 user nova-compute[74587]: DEBUG nova.compute.manager [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:09:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-5b831b7c-61d5-4643-b551-bee3aedb6675 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:09:06 user nova-compute[74587]: INFO nova.compute.claims [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Claim successful on node user
Oct 18 07:09:06 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:09:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:09:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:09:06 user nova-compute[74587]: INFO nova.virt.block_device [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Booting with volume 18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 at /dev/vda
Oct 18 07:09:06 user nova-compute[74587]: DEBUG nova.policy [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04930d45ee104e2f91e46e277bf1f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba117ef53fc64403ad516a9860cb28f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG os_brick.utils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6ee8bb-f907-4d50-9a6d-ea655c52ae8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3539e748-354b-41c2-bd49-77e3c2311e21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2917ad86-0ae0-4c03-ac2d-4c80483cc40c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e2c58e-61e4-495d-8cea-7a70dc20c978]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:06 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:09:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a68548-4da6-4d27-a1df-4326c1652eb6]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:09:06 user nova-compute[74587]: DEBUG os_brick.utils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:09:07 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating existing volume attachment record: 082315ee-b041-42d3-8c71-a4bcad48c48f {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:09:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:09:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:07 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:09:07 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully created port: 04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:09:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:07 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Snapshot image upload complete
Oct 18 07:09:07 user nova-compute[74587]: INFO nova.compute.manager [None req-8b368555-7d9f-4fb0-9490-aa60226896d9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Took 6.09 seconds to snapshot the instance on the hypervisor.
Oct 18 07:09:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully created port: f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:09 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully created port: 2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:09:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:09 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully created port: 1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:09:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully created port: b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:10 user nova-compute[74587]: INFO nova.virt.block_device [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Booting with volume a5f216cf-3b7d-4dce-9eb6-49b63181b3ae at /dev/vdb
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG os_brick.utils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[439426d9-a3ce-4408-a2d3-6a98d85413bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca7beb-0d53-4b26-9686-ae99ab479faf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d146ef48-7384-49ed-ad4e-2b67821e6db6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[677e3aba-5dcf-49cf-8d59-6de29d338679]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:10 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fa7fd1-89f0-4c54-b61b-16ffda35d8f5]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG os_brick.utils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating existing volume attachment record: a5c7ebad-4799-4f62-b787-a4f78835fa9c {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:09:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully updated port: 04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-cea1d789-436e-42d7-b434-de61733832b3 req-67a49999-73d8-4135-87eb-87fe84e7fbb2 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-changed-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-cea1d789-436e-42d7-b434-de61733832b3 req-67a49999-73d8-4135-87eb-87fe84e7fbb2 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing instance network info cache due to event network-changed-04ebae1c-d00a-46dd-8afa-2c8c24c04848. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cea1d789-436e-42d7-b434-de61733832b3 req-67a49999-73d8-4135-87eb-87fe84e7fbb2 service nova] Acquiring lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cea1d789-436e-42d7-b434-de61733832b3 req-67a49999-73d8-4135-87eb-87fe84e7fbb2 service nova] Acquired lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG nova.network.neutron [req-cea1d789-436e-42d7-b434-de61733832b3 req-67a49999-73d8-4135-87eb-87fe84e7fbb2 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing network info cache for port 04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG nova.network.neutron [req-cea1d789-436e-42d7-b434-de61733832b3 req-67a49999-73d8-4135-87eb-87fe84e7fbb2 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully updated port: 0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:09:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully updated port: 74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-cea1d789-436e-42d7-b434-de61733832b3 req-67a49999-73d8-4135-87eb-87fe84e7fbb2 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-094b2a8b-64a4-45f0-96d0-4ef0a37de7ac req-35201326-e803-4409-a489-77d161a3ea10 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-changed-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-094b2a8b-64a4-45f0-96d0-4ef0a37de7ac req-35201326-e803-4409-a489-77d161a3ea10 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Refreshing instance network info cache due to event network-changed-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-094b2a8b-64a4-45f0-96d0-4ef0a37de7ac req-35201326-e803-4409-a489-77d161a3ea10 service nova] Acquiring lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-094b2a8b-64a4-45f0-96d0-4ef0a37de7ac req-35201326-e803-4409-a489-77d161a3ea10 service nova] Acquired lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-094b2a8b-64a4-45f0-96d0-4ef0a37de7ac req-35201326-e803-4409-a489-77d161a3ea10 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Refreshing network info cache for port 1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cea1d789-436e-42d7-b434-de61733832b3 req-67a49999-73d8-4135-87eb-87fe84e7fbb2 service nova] Releasing lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:13 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:09:13 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7303MB free_disk=25.4947509765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-changed-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing instance network info cache due to event network-changed-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] Acquiring lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] Acquired lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing network info cache for port 0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 4ef9e718-1203-413a-909f-b0cf90a5b2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 205d8114-61a9-4108-9f65-042656ad2a69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance fe149618-b362-4460-84d3-1b8e0e56f2f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance c17be69f-69e9-455c-9f83-5b2851b1d646 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:13 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully updated port: f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] Releasing lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-changed-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing instance network info cache due to event network-changed-74e6c08f-3e16-430b-bc6d-c2ea430c75b2. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] Acquiring lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] Acquired lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing network info cache for port 74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-094b2a8b-64a4-45f0-96d0-4ef0a37de7ac req-35201326-e803-4409-a489-77d161a3ea10 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updated VIF entry in instance network info cache for port 1f61b2a7-a701-4ffd-bf37-76309f8f9b5a. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-094b2a8b-64a4-45f0-96d0-4ef0a37de7ac req-35201326-e803-4409-a489-77d161a3ea10 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating instance_info_cache with network_info: [{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-094b2a8b-64a4-45f0-96d0-4ef0a37de7ac req-35201326-e803-4409-a489-77d161a3ea10 service nova] Releasing lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1524cf08-d529-4691-a99f-4662b0c3a323 req-d497f37f-b1a9-4532-96ec-c1f5b93c5d0e service nova] Releasing lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:14 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully updated port: 2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-changed-f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing instance network info cache due to event network-changed-f194c977-6d80-481e-aee6-31acfc3f10f8. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] Acquiring lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] Acquired lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing network info cache for port f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] Releasing lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-changed-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing instance network info cache due to event network-changed-2e30d3ed-1d43-4cc9-b452-eeb149c007a7. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] Acquiring lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] Acquired lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing network info cache for port 2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully updated port: 1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7180b7b1-3a05-4cd0-a0a3-7a112f2204cd req-dc8049a0-1ed3-4407-8f62-feb528399c44 service nova] Releasing lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:09:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Successfully updated port: b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:09:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquired lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:09:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:09:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-changed-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing instance network info cache due to event network-changed-1ceed310-b30b-4ea9-88d7-6fb43a041bb8. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] Acquiring lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG nova.network.neutron [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [{"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Releasing lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG nova.compute.manager [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Instance network_info: |[{"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] Acquired lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG nova.network.neutron [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing network info cache for port 1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG nova.network.neutron [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updated VIF entry in instance network info cache for port 1ceed310-b30b-4ea9-88d7-6fb43a041bb8. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG nova.network.neutron [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [{"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] Releasing lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG nova.compute.manager [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-changed-b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG nova.compute.manager [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing instance network info cache due to event network-changed-b48ddaee-bb23-4b91-b54b-9c0ca783f780. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] Acquiring lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] Acquired lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:18 user nova-compute[74587]: DEBUG nova.network.neutron [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing network info cache for port b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:19 user nova-compute[74587]: DEBUG nova.network.neutron [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updated VIF entry in instance network info cache for port b48ddaee-bb23-4b91-b54b-9c0ca783f780. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:19 user nova-compute[74587]: DEBUG nova.network.neutron [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [{"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d418515f-888e-418f-8458-36191526b195 req-c212bb83-2084-4d61-9451-c845f16a81a5 service nova] Releasing lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-871d1769-f058-4527-819f-c948eb01ec30 req-b69b5165-7c7f-40ba-9fa7-61e5c96c0f03 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received event network-changed-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-871d1769-f058-4527-819f-c948eb01ec30 req-b69b5165-7c7f-40ba-9fa7-61e5c96c0f03 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Refreshing instance network info cache due to event network-changed-3bf1510a-3efc-4d46-b016-ffeacfc7025e. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-871d1769-f058-4527-819f-c948eb01ec30 req-b69b5165-7c7f-40ba-9fa7-61e5c96c0f03 service nova] Acquiring lock "refresh_cache-4ef9e718-1203-413a-909f-b0cf90a5b2b9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-871d1769-f058-4527-819f-c948eb01ec30 req-b69b5165-7c7f-40ba-9fa7-61e5c96c0f03 service nova] Acquired lock "refresh_cache-4ef9e718-1203-413a-909f-b0cf90a5b2b9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:27 user nova-compute[74587]: DEBUG nova.network.neutron [req-871d1769-f058-4527-819f-c948eb01ec30 req-b69b5165-7c7f-40ba-9fa7-61e5c96c0f03 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Refreshing network info cache for port 3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-871d1769-f058-4527-819f-c948eb01ec30 req-b69b5165-7c7f-40ba-9fa7-61e5c96c0f03 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Updated VIF entry in instance network info cache for port 3bf1510a-3efc-4d46-b016-ffeacfc7025e. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-871d1769-f058-4527-819f-c948eb01ec30 req-b69b5165-7c7f-40ba-9fa7-61e5c96c0f03 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Updating instance_info_cache with network_info: [{"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-871d1769-f058-4527-819f-c948eb01ec30 req-b69b5165-7c7f-40ba-9fa7-61e5c96c0f03 service nova] Releasing lock "refresh_cache-4ef9e718-1203-413a-909f-b0cf90a5b2b9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-022b7b56-975d-485b-a4ea-31c7d6d8a26a req-a72b547b-3798-4d4d-8c4d-56dc9aa48a5a service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received event network-changed-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-022b7b56-975d-485b-a4ea-31c7d6d8a26a req-a72b547b-3798-4d4d-8c4d-56dc9aa48a5a service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Refreshing instance network info cache due to event network-changed-d128c6b4-8685-4248-bb78-1aafbf1ac017. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-022b7b56-975d-485b-a4ea-31c7d6d8a26a req-a72b547b-3798-4d4d-8c4d-56dc9aa48a5a service nova] Acquiring lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-022b7b56-975d-485b-a4ea-31c7d6d8a26a req-a72b547b-3798-4d4d-8c4d-56dc9aa48a5a service nova] Acquired lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-022b7b56-975d-485b-a4ea-31c7d6d8a26a req-a72b547b-3798-4d4d-8c4d-56dc9aa48a5a service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Refreshing network info cache for port d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-022b7b56-975d-485b-a4ea-31c7d6d8a26a req-a72b547b-3798-4d4d-8c4d-56dc9aa48a5a service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Updated VIF entry in instance network info cache for port d128c6b4-8685-4248-bb78-1aafbf1ac017. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-022b7b56-975d-485b-a4ea-31c7d6d8a26a req-a72b547b-3798-4d4d-8c4d-56dc9aa48a5a service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Updating instance_info_cache with network_info: [{"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-022b7b56-975d-485b-a4ea-31c7d6d8a26a req-a72b547b-3798-4d4d-8c4d-56dc9aa48a5a service nova] Releasing lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:29 user nova-compute[74587]: INFO nova.virt.block_device [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Booting with volume e7449dd8-385c-486b-8a80-ce0c79fd4236 at /dev/vdc
Oct 18 07:09:29 user nova-compute[74587]: INFO nova.virt.block_device [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Booting with volume 3e76c0dc-dc0c-4508-a142-8aa97ba64e63 at /dev/vdb
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.utils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdb68e8-9c82-4f3d-a43d-4fc267e5c758]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dc3378-619d-4d56-b3e0-21aa1d75f842]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c0bec0-e103-42ac-9f26-9aa2cbe398b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f8dda0-18ef-4724-aff2-1395bc459439]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.utils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[874d13ac-a3c3-4119-80d2-51cbc83288d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:29 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e165b65-222b-4491-9cf5-2190fa2dd15f]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.utils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating existing volume attachment record: c52b3687-d809-4881-bb26-f873dc06bc49 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd05a9fd-eacf-444d-b95f-e97350ac565a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64be16e-6b96-427c-8b58-370f6838b363]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f151f1e-abde-4efa-954a-dc3808cc9462]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:29 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:09:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[689fc833-2bc4-4a7f-8401-0c5b4ccbc180]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG os_brick.utils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:09:29 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating existing volume attachment record: bd156a3e-5795-4770-ae6b-8727195311a5 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:09:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG nova.objects.instance [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lazy-loading 'flavor' on Instance uuid 4ef9e718-1203-413a-909f-b0cf90a5b2b9 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:33 user nova-compute[74587]: INFO nova.compute.manager [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Attaching volume f62d56c1-bf90-4585-b4ca-fd530f6fa470 to /dev/sdc
Oct 18 07:09:33 user nova-compute[74587]: DEBUG os_brick.utils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[33631ebd-cfc4-4378-a556-50491460c3cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6847ff5-a73f-4748-bb2e-93f416f74ad2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[44df1106-01d4-466f-a54f-10527b206e01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f82e4ab-17bc-40f6-9a54-dd3fe36bd241]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:33 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:09:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[06102ce5-0b1a-492a-85c8-9b0d5dba86be]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG os_brick.utils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:09:33 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Updating existing volume attachment record: 30197374-2f93-48f8-ba2f-1c9874949fbc {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:09:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-f6f8cc34-3348-4b2a-96d9-85c02b646441 req-cb626049-629c-4396-86e0-0df21971b3cd service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-changed-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-f6f8cc34-3348-4b2a-96d9-85c02b646441 req-cb626049-629c-4396-86e0-0df21971b3cd service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Refreshing instance network info cache due to event network-changed-ddbc6964-8191-4483-8a63-2c853584be6f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f6f8cc34-3348-4b2a-96d9-85c02b646441 req-cb626049-629c-4396-86e0-0df21971b3cd service nova] Acquiring lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f6f8cc34-3348-4b2a-96d9-85c02b646441 req-cb626049-629c-4396-86e0-0df21971b3cd service nova] Acquired lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:37 user nova-compute[74587]: DEBUG nova.network.neutron [req-f6f8cc34-3348-4b2a-96d9-85c02b646441 req-cb626049-629c-4396-86e0-0df21971b3cd service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Refreshing network info cache for port ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:38 user nova-compute[74587]: DEBUG nova.network.neutron [req-f6f8cc34-3348-4b2a-96d9-85c02b646441 req-cb626049-629c-4396-86e0-0df21971b3cd service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updated VIF entry in instance network info cache for port ddbc6964-8191-4483-8a63-2c853584be6f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:38 user nova-compute[74587]: DEBUG nova.network.neutron [req-f6f8cc34-3348-4b2a-96d9-85c02b646441 req-cb626049-629c-4396-86e0-0df21971b3cd service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updating instance_info_cache with network_info: [{"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f6f8cc34-3348-4b2a-96d9-85c02b646441 req-cb626049-629c-4396-86e0-0df21971b3cd service nova] Releasing lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "interface-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "interface-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:38 user nova-compute[74587]: DEBUG nova.objects.instance [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lazy-loading 'flavor' on Instance uuid 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:38 user nova-compute[74587]: DEBUG nova.objects.instance [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lazy-loading 'pci_requests' on Instance uuid 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:38 user nova-compute[74587]: DEBUG nova.objects.base [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Object Instance<2c672325-def3-49a9-a7b2-9dfb4fa0ce2c> lazy-loaded attributes: flavor,pci_requests {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:09:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:09:38 user nova-compute[74587]: DEBUG nova.policy [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42bc78aefa2847238a3b25da59c9a148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884f75b337bf4ab5b239e3e1e16954ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Successfully created port: 7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-7b6f8dc4-d28b-4812-8994-e7363c3a619c req-77a70ea5-763a-4360-b2fa-6d20b32ebce3 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received event network-changed-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-7b6f8dc4-d28b-4812-8994-e7363c3a619c req-77a70ea5-763a-4360-b2fa-6d20b32ebce3 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Refreshing instance network info cache due to event network-changed-0d782334-b135-4c85-94f5-45c448d3256c. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7b6f8dc4-d28b-4812-8994-e7363c3a619c req-77a70ea5-763a-4360-b2fa-6d20b32ebce3 service nova] Acquiring lock "refresh_cache-205d8114-61a9-4108-9f65-042656ad2a69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7b6f8dc4-d28b-4812-8994-e7363c3a619c req-77a70ea5-763a-4360-b2fa-6d20b32ebce3 service nova] Acquired lock "refresh_cache-205d8114-61a9-4108-9f65-042656ad2a69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG nova.network.neutron [req-7b6f8dc4-d28b-4812-8994-e7363c3a619c req-77a70ea5-763a-4360-b2fa-6d20b32ebce3 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Refreshing network info cache for port 0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Successfully updated port: 7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquired lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-e2bbd910-e0fd-4403-a5db-2425ddb8507d req-5929321c-decc-467c-8b3f-83767ee2eb07 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-changed-7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-e2bbd910-e0fd-4403-a5db-2425ddb8507d req-5929321c-decc-467c-8b3f-83767ee2eb07 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Refreshing instance network info cache due to event network-changed-7a367dbf-bcb5-437b-bd09-626f377a43da. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e2bbd910-e0fd-4403-a5db-2425ddb8507d req-5929321c-decc-467c-8b3f-83767ee2eb07 service nova] Acquiring lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-7b6f8dc4-d28b-4812-8994-e7363c3a619c req-77a70ea5-763a-4360-b2fa-6d20b32ebce3 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Updated VIF entry in instance network info cache for port 0d782334-b135-4c85-94f5-45c448d3256c. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-7b6f8dc4-d28b-4812-8994-e7363c3a619c req-77a70ea5-763a-4360-b2fa-6d20b32ebce3 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Updating instance_info_cache with network_info: [{"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7b6f8dc4-d28b-4812-8994-e7363c3a619c req-77a70ea5-763a-4360-b2fa-6d20b32ebce3 service nova] Releasing lock "refresh_cache-205d8114-61a9-4108-9f65-042656ad2a69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updating instance_info_cache with network_info: [{"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a367dbf-bcb5-437b-bd09-626f377a43da", "address": "fa:16:3e:0e:4e:e8", "network": {"id": "8442b85a-b072-41ed-86fd-ec9e6b3f2f4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-873154978", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a367dbf-bc", "ovs_interfaceid": "7a367dbf-bcb5-437b-bd09-626f377a43da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Releasing lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e2bbd910-e0fd-4403-a5db-2425ddb8507d req-5929321c-decc-467c-8b3f-83767ee2eb07 service nova] Acquired lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-e2bbd910-e0fd-4403-a5db-2425ddb8507d req-5929321c-decc-467c-8b3f-83767ee2eb07 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Refreshing network info cache for port 7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-675565366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-675565366',id=7,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEO5dx++IX4ljOuW+qNj5hpC2x51PQ/SXgUWZY1ekvFYqfyCilmR4DC2lOZdcQco8cKcpkEKyVcg6SoQUuKw0WDM3TFiS+hwHnBjz0Ph4sNwOOd+murzzpvCJKAO0syDw==',key_name='tempest-keypair-1735451947',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='884f75b337bf4ab5b239e3e1e16954ed',ramdisk_id='',reservation_id='r-6o10505b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-259044806',owner_user_name='tempest-TaggedAttachmentsTest-259044806-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42bc78aefa2847238a3b25da59c9a148',uuid=2c672325-def3-49a9-a7b2-9dfb4fa0ce2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a367dbf-bcb5-437b-bd09-626f377a43da", "address": "fa:16:3e:0e:4e:e8", "network": {"id": "8442b85a-b072-41ed-86fd-ec9e6b3f2f4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-873154978", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a367dbf-bc", "ovs_interfaceid": "7a367dbf-bcb5-437b-bd09-626f377a43da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converting VIF {"id": "7a367dbf-bcb5-437b-bd09-626f377a43da", "address": "fa:16:3e:0e:4e:e8", "network": {"id": "8442b85a-b072-41ed-86fd-ec9e6b3f2f4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-873154978", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a367dbf-bc", "ovs_interfaceid": "7a367dbf-bcb5-437b-bd09-626f377a43da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4e:e8,bridge_name='br-int',has_traffic_filtering=True,id=7a367dbf-bcb5-437b-bd09-626f377a43da,network=Network(8442b85a-b072-41ed-86fd-ec9e6b3f2f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a367dbf-bc') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG os_vif [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4e:e8,bridge_name='br-int',has_traffic_filtering=True,id=7a367dbf-bcb5-437b-bd09-626f377a43da,network=Network(8442b85a-b072-41ed-86fd-ec9e6b3f2f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a367dbf-bc') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '908f8020-d764-59b7-8630-302adc211052', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a367dbf-bc, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a367dbf-bc, col_values=(('qos', UUID('3781e6be-a38b-4846-b0e0-b047e974de08')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a367dbf-bc, col_values=(('external_ids', {'iface-id': '7a367dbf-bcb5-437b-bd09-626f377a43da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:4e:e8', 'vm-uuid': '2c672325-def3-49a9-a7b2-9dfb4fa0ce2c'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:40 user nova-compute[74587]: INFO os_vif [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4e:e8,bridge_name='br-int',has_traffic_filtering=True,id=7a367dbf-bcb5-437b-bd09-626f377a43da,network=Network(8442b85a-b072-41ed-86fd-ec9e6b3f2f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a367dbf-bc')
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-675565366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-675565366',id=7,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEO5dx++IX4ljOuW+qNj5hpC2x51PQ/SXgUWZY1ekvFYqfyCilmR4DC2lOZdcQco8cKcpkEKyVcg6SoQUuKw0WDM3TFiS+hwHnBjz0Ph4sNwOOd+murzzpvCJKAO0syDw==',key_name='tempest-keypair-1735451947',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='884f75b337bf4ab5b239e3e1e16954ed',ramdisk_id='',reservation_id='r-6o10505b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-259044806',owner_user_name='tempest-TaggedAttachmentsTest-259044806-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42bc78aefa2847238a3b25da59c9a148',uuid=2c672325-def3-49a9-a7b2-9dfb4fa0ce2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a367dbf-bcb5-437b-bd09-626f377a43da", "address": "fa:16:3e:0e:4e:e8", "network": {"id": "8442b85a-b072-41ed-86fd-ec9e6b3f2f4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-873154978", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a367dbf-bc", "ovs_interfaceid": "7a367dbf-bcb5-437b-bd09-626f377a43da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converting VIF {"id": "7a367dbf-bcb5-437b-bd09-626f377a43da", "address": "fa:16:3e:0e:4e:e8", "network": {"id": "8442b85a-b072-41ed-86fd-ec9e6b3f2f4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-873154978", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a367dbf-bc", "ovs_interfaceid": "7a367dbf-bcb5-437b-bd09-626f377a43da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4e:e8,bridge_name='br-int',has_traffic_filtering=True,id=7a367dbf-bcb5-437b-bd09-626f377a43da,network=Network(8442b85a-b072-41ed-86fd-ec9e6b3f2f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a367dbf-bc') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] attach device xml: <interface type="ethernet">
Oct 18 07:09:40 user nova-compute[74587]:   <mac address="fa:16:3e:0e:4e:e8"/>
Oct 18 07:09:40 user nova-compute[74587]:   <model type="virtio"/>
Oct 18 07:09:40 user nova-compute[74587]:   <mtu size="1442"/>
Oct 18 07:09:40 user nova-compute[74587]:   <target dev="tap7a367dbf-bc"/>
Oct 18 07:09:40 user nova-compute[74587]: </interface>
Oct 18 07:09:40 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] No BDM found with device name hda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] No VIF found with MAC fa:16:3e:9c:6f:78, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-e2bbd910-e0fd-4403-a5db-2425ddb8507d req-5929321c-decc-467c-8b3f-83767ee2eb07 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updated VIF entry in instance network info cache for port 7a367dbf-bcb5-437b-bd09-626f377a43da. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-e2bbd910-e0fd-4403-a5db-2425ddb8507d req-5929321c-decc-467c-8b3f-83767ee2eb07 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updating instance_info_cache with network_info: [{"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a367dbf-bcb5-437b-bd09-626f377a43da", "address": "fa:16:3e:0e:4e:e8", "network": {"id": "8442b85a-b072-41ed-86fd-ec9e6b3f2f4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-873154978", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a367dbf-bc", "ovs_interfaceid": "7a367dbf-bcb5-437b-bd09-626f377a43da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:09:40 user nova-compute[74587]:   <nova:package version="0.0.0"/>
Oct 18 07:09:40 user nova-compute[74587]:   <nova:name>tempest-device-tagging-server-675565366</nova:name>
Oct 18 07:09:40 user nova-compute[74587]:   <nova:creationTime>2023-10-18 07:09:40</nova:creationTime>
Oct 18 07:09:40 user nova-compute[74587]:   <nova:flavor name="m1.tiny">
Oct 18 07:09:40 user nova-compute[74587]:     <nova:memory>512</nova:memory>
Oct 18 07:09:40 user nova-compute[74587]:     <nova:disk>1</nova:disk>
Oct 18 07:09:40 user nova-compute[74587]:     <nova:swap>0</nova:swap>
Oct 18 07:09:40 user nova-compute[74587]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:09:40 user nova-compute[74587]:     <nova:vcpus>1</nova:vcpus>
Oct 18 07:09:40 user nova-compute[74587]:   </nova:flavor>
Oct 18 07:09:40 user nova-compute[74587]:   <nova:owner>
Oct 18 07:09:40 user nova-compute[74587]:     <nova:user uuid="42bc78aefa2847238a3b25da59c9a148">tempest-TaggedAttachmentsTest-259044806-project-member</nova:user>
Oct 18 07:09:40 user nova-compute[74587]:     <nova:project uuid="884f75b337bf4ab5b239e3e1e16954ed">tempest-TaggedAttachmentsTest-259044806</nova:project>
Oct 18 07:09:40 user nova-compute[74587]:   </nova:owner>
Oct 18 07:09:40 user nova-compute[74587]:   <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:09:40 user nova-compute[74587]:   <nova:ports>
Oct 18 07:09:40 user nova-compute[74587]:     <nova:port uuid="ddbc6964-8191-4483-8a63-2c853584be6f">
Oct 18 07:09:40 user nova-compute[74587]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 07:09:40 user nova-compute[74587]:     </nova:port>
Oct 18 07:09:40 user nova-compute[74587]:     <nova:port uuid="7a367dbf-bcb5-437b-bd09-626f377a43da">
Oct 18 07:09:40 user nova-compute[74587]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Oct 18 07:09:40 user nova-compute[74587]:     </nova:port>
Oct 18 07:09:40 user nova-compute[74587]:   </nova:ports>
Oct 18 07:09:40 user nova-compute[74587]: </nova:instance>
Oct 18 07:09:40 user nova-compute[74587]:  {{(pid=74587) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e2bbd910-e0fd-4403-a5db-2425ddb8507d req-5929321c-decc-467c-8b3f-83767ee2eb07 service nova] Releasing lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-58bddd0b-25e6-4dd2-8436-88946b1e9d36 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "interface-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.520s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-plugged-7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] No waiting events found dispatching network-vif-plugged-7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:09:41 user nova-compute[74587]: WARNING nova.compute.manager [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received unexpected event network-vif-plugged-7a367dbf-bcb5-437b-bd09-626f377a43da for instance with vm_state active and task_state None.
Oct 18 07:09:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-plugged-7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] No waiting events found dispatching network-vif-plugged-7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:09:41 user nova-compute[74587]: WARNING nova.compute.manager [req-1b85f754-be05-4014-bed0-e0291bab8459 req-77f595da-0574-4bb8-a6c8-d9ac169a9b6c service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received unexpected event network-vif-plugged-7a367dbf-bcb5-437b-bd09-626f377a43da for instance with vm_state active and task_state None.
Oct 18 07:09:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-b6e4438b-cf01-4060-b96f-d87355130941 req-62c399ed-2984-4fe9-b145-18b888cdca15 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received event network-changed-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:09:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-b6e4438b-cf01-4060-b96f-d87355130941 req-62c399ed-2984-4fe9-b145-18b888cdca15 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Refreshing instance network info cache due to event network-changed-c050b165-f76e-484d-a030-09f32640e911. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:09:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b6e4438b-cf01-4060-b96f-d87355130941 req-62c399ed-2984-4fe9-b145-18b888cdca15 service nova] Acquiring lock "refresh_cache-fe0bd998-4fb1-45fc-a2c3-c3486c54754d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:09:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b6e4438b-cf01-4060-b96f-d87355130941 req-62c399ed-2984-4fe9-b145-18b888cdca15 service nova] Acquired lock "refresh_cache-fe0bd998-4fb1-45fc-a2c3-c3486c54754d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:09:47 user nova-compute[74587]: DEBUG nova.network.neutron [req-b6e4438b-cf01-4060-b96f-d87355130941 req-62c399ed-2984-4fe9-b145-18b888cdca15 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Refreshing network info cache for port c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:09:47 user nova-compute[74587]: DEBUG nova.network.neutron [req-b6e4438b-cf01-4060-b96f-d87355130941 req-62c399ed-2984-4fe9-b145-18b888cdca15 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Updated VIF entry in instance network info cache for port c050b165-f76e-484d-a030-09f32640e911. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:09:47 user nova-compute[74587]: DEBUG nova.network.neutron [req-b6e4438b-cf01-4060-b96f-d87355130941 req-62c399ed-2984-4fe9-b145-18b888cdca15 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Updating instance_info_cache with network_info: [{"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:09:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b6e4438b-cf01-4060-b96f-d87355130941 req-62c399ed-2984-4fe9-b145-18b888cdca15 service nova] Releasing lock "refresh_cache-fe0bd998-4fb1-45fc-a2c3-c3486c54754d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:09:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connector [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Factory for ISCSI on None {{(pid=74587) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKkiDUHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:09:51 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:09:51 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:09:51 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b384fa0a-862a-4f69-b810-7a2a641b6dd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:09:51 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce687448-474b-4e1d-a467-f363b7837010]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470] added
Oct 18 07:09:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78299d0-0786-45c0-8135-a989c5caaa40]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[be56bd9c-d516-402b-bb2d-835755c4e910]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKkiDUHP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKkiDUHP" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4701ce9d-e503-4450-b415-fbb33a9f7d42]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XKkiDUHP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[362871a0-c2da-4858-8d21-dfe917ae5bc3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lazy-loading 'flavor' on Instance uuid 205d8114-61a9-4108-9f65-042656ad2a69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8249e08b-62a8-4e8d-a694-76ca15752a19]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:09:51 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:09:51 user nova-compute[74587]:  {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:09:51 user nova-compute[74587]: WARNING os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 07:09:51 user nova-compute[74587]: 
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lazy-loading 'flavor' on Instance uuid 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab98f523-6643-4e0a-a4a6-c9d0501afd86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470, portal: 172.16.0.220,3260]
Oct 18 07:09:51 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470, portal: 172.16.0.220,3260] successful.
Oct 18 07:09:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Acquiring lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0b8878-698b-4328-a7af-e7726bf4fdff]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG nova.objects.instance [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lazy-loading 'flavor' on Instance uuid fe0bd998-4fb1-45fc-a2c3-c3486c54754d {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb660823-cac5-4f73-b4d7-f5701c0bc083]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:09:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:09:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc24d4d-f497-4ccb-a739-4c2e5069cb9b]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKkiDUHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:51 user nova-compute[74587]: INFO nova.compute.manager [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Attaching volume 6b6131b2-2f92-496e-98b0-5ab9386bcefd to /dev/vdb
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:52 user nova-compute[74587]: INFO nova.compute.manager [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Attaching volume a9375339-bbe2-47a4-9083-9ec645a09ecb to /dev/vdb
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Acquiring lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:52 user nova-compute[74587]: INFO nova.compute.manager [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Attaching volume b269a736-e0bf-45b7-b758-b99dfb408016 to /dev/vdb
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG nova.objects.instance [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lazy-loading 'flavor' on Instance uuid 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.utils [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8038d10e-3d49-4cfe-b84e-ee4a21bdb263]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb83152-df29-49e6-b4bd-3c87c0d0ed3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.utils [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caab005-d2f1-41db-98e5-5309f92dfe83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0ff70a-9e3a-4400-a9cc-c2c72f3288db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cb53e0-8837-45fe-863c-d4bebcf11909]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.utils [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed3f17f-6424-464b-991e-2b8e122352b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe823b80-d017-45f5-9b0a-c57adbec09e2]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.utils [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updating existing volume attachment record: 858d63b1-b8d3-4f6d-bc2a-afe39a973b9f {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3cbd6e-99dc-4dfd-b5a2-382aa3cc9b5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f762e387-a673-409b-ab3e-8342676e8e57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06519ef-4d22-4a97-afde-4187546cbdf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[644b561f-56b1-468e-bef1-1bc6a85cfe00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a5e5e8-a88a-4892-8b97-47fce69ef8c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23932636363653064', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932636363653064', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[867f3a64-d48a-4680-9f03-f99fc782a7a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:52 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bf6f8b-769d-448c-b05b-5b2871e18522]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG nova.objects.instance [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lazy-loading 'flavor' on Instance uuid 4ef9e718-1203-413a-909f-b0cf90a5b2b9 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.utils [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Updating existing volume attachment record: 5f0d38da-a412-4520-bde0-0cf57cdf26cc {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:09:52 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:09:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b24cc7c-02d8-460f-9b63-c8bc46482ec3]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG os_brick.utils [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Updating existing volume attachment record: 5d9424fa-6707-4946-be15-5c04bf96bd9d {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:09:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:09:52 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:09:52 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:09:52 user nova-compute[74587]:   <target dev="sdc" bus="scsi"/>
Oct 18 07:09:52 user nova-compute[74587]:   <serial>f62d56c1-bf90-4585-b4ca-fd530f6fa470</serial>
Oct 18 07:09:52 user nova-compute[74587]:   <address type="drive" controller="0" unit="2"/>
Oct 18 07:09:52 user nova-compute[74587]: </disk>
Oct 18 07:09:52 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:09:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:09:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:09:53 user nova-compute[74587]: INFO nova.compute.manager [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Attaching volume e26d4d6e-01b5-4d64-8c1e-d91f5076d997 to /dev/vdb
Oct 18 07:09:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] No BDM found with device name sda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:09:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:09:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:09:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] No VIF found with MAC fa:16:3e:02:e7:a8, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:09:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:09:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:10:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:10:03 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:10:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:10:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:06 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:10:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:10:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:10:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:10:06 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:10:06 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updating instance_info_cache with network_info: [{"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:10:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:10:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:10:06 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:10:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:10:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:10:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:10:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:08 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:10:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:10:09 user nova-compute[74587]: INFO nova.compute.claims [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Claim successful on node user
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (sdc) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:10:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKfCMtli', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:10 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:10 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:10 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51f99bb-ffe5-436d-957e-daa9088654da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:10:10 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[827b8943-6771-460f-9d91-0e7f9185c869]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd] added
Oct 18 07:10:10 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[76169817-d9d3-4363-9035-5b5ad0f95dbc]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG nova.policy [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2ca09ce37384d25931eb9a658384255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c002a125aec54fa388965a9f83cc1624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8cb5bf-26a9-4170-b9e7-35ac09ce4bbb]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FKfCMtli {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: INFO nova.virt.block_device [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Booting with blank volume at /dev/vda
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FKfCMtli" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc14434-4602-43d8-9455-aa92faaf96ee]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FKfCMtli'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ece8c82-1d73-42ff-a6d2-4bc34f246c89]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dccc28-31b0-4ee4-9599-e45651ad913c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:10 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:10 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedea55f-a9b6-41d9-8802-2db2f672dcba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd, portal: 172.16.0.220,3260]
Oct 18 07:10:10 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd, portal: 172.16.0.220,3260] successful.
Oct 18 07:10:10 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[00460b01-b5f4-41aa-9fd9-7979eeada309]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7211c923-c7c0-4eaf-8d18-8c1510a2612c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:11 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:11 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-33c627b0-5ee3-40f4-ab16-c62c19ca647d tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.595s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[29080f54-f29c-419d-b2dc-a2b50082ce8d]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKfCMtli', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:11 user nova-compute[74587]: INFO nova.virt.block_device [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Booting with volume b53ded95-5612-47e8-acd5-1f6846e7e8f8 at /dev/vdc
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Successfully created port: 6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:10:11 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Creating image(s)
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Ensure instance console log exists: /opt/stack/data/nova/instances/fe149618-b362-4460-84d3-1b8e0e56f2f7/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Start _get_guest_xml network_info=[{"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4d7c59a9-a63b-4a60-83bd-9f6039dc8208', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezaEDxdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fe149618-b362-4460-84d3-1b8e0e56f2f7', 'attached_at': '', 'detached_at': '', 'volume_id': '60d52911-fe77-4279-ac00-17cf830c6e12', 'serial': '60d52911-fe77-4279-ac00-17cf830c6e12'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'a5c7ebad-4799-4f62-b787-a4f78835fa9c', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzfrwtDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fe149618-b362-4460-84d3-1b8e0e56f2f7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5f216cf-3b7d-4dce-9eb6-49b63181b3ae', 'serial': 'a5f216cf-3b7d-4dce-9eb6-49b63181b3ae'}, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'c52b3687-d809-4881-bb26-f873dc06bc49', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GrZOAyzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fe149618-b362-4460-84d3-1b8e0e56f2f7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7449dd8-385c-486b-8a80-ce0c79fd4236', 'serial': 'e7449dd8-385c-486b-8a80-ce0c79fd4236'}, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:11 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:10:11 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezaEDxdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:11 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.utils [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd793e9-401f-4dc8-8caa-f08823342a1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f94c7f-e668-47b6-8ffc-38574b6a562f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e335f93-0f16-4899-838b-4d6ea884bca3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d22f2-7f18-41f0-b3e8-19e6138673c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:10:11 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[af39f110-5ce0-4d02-ae03-dfdb4b4f9a61]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG os_brick.utils [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Updating existing volume attachment record: e8f44c40-c16c-48b0-9c30-844c22ce00d9 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23464376636633930', 'path': '/dev/sdc'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464376636633930', 'path': '/dev/sdc'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.493s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:12 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:12 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lazy-loading 'flavor' on Instance uuid 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62c696b-a204-4567-b466-7779b9f8bcfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:10:12 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:10:12 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:12 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:10:12 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:10:12 user nova-compute[74587]:   <serial>6b6131b2-2f92-496e-98b0-5ab9386bcefd</serial>
Oct 18 07:10:12 user nova-compute[74587]: </disk>
Oct 18 07:10:12 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8eaa55-37fe-4689-b789-06791e61b71d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12] added
Oct 18 07:10:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d7a70d-7fd9-4c3a-af0f-9177ded0886b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Successfully updated port: 6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd57c57d-9839-4e24-a150-2b12697e16a1]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ezaEDxdQ {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquired lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ezaEDxdQ" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d5f17-597f-4ff6-a6dd-befb42d8b34d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ezaEDxdQ'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-5e17acc8-c4e5-45b7-94fb-99803261d9b4 req-61c3b7ff-ff4f-41f9-8f17-f11605dcd38f service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-changed-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-5e17acc8-c4e5-45b7-94fb-99803261d9b4 req-61c3b7ff-ff4f-41f9-8f17-f11605dcd38f service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Refreshing instance network info cache due to event network-changed-6776f41a-346e-45fa-a618-bc4f28583854. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5e17acc8-c4e5-45b7-94fb-99803261d9b4 req-61c3b7ff-ff4f-41f9-8f17-f11605dcd38f service nova] Acquiring lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[377785c8-030a-45b9-a727-5c8280bd5efb]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2634c87-bdfd-4186-bd4f-e4edfab7dd3d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:12 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:12 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e3d49e-6cf2-49f6-8fe2-49d4b62c4346]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12, portal: 172.16.0.220,3260]
Oct 18 07:10:12 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12, portal: 172.16.0.220,3260] successful.
Oct 18 07:10:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[591b7c5a-a7cf-4b98-893b-8bc33b28f604]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef68633e-aedd-4310-be40-a4fd34419a52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:12 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:12 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:12 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:12 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[677936ad-f762-4e8c-bdff-f622fc9d0dd5]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezaEDxdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] No BDM found with device name hda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] No VIF found with MAC fa:16:3e:9c:6f:78, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updating instance_info_cache with network_info: [{"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Releasing lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Instance network_info: |[{"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5e17acc8-c4e5-45b7-94fb-99803261d9b4 req-61c3b7ff-ff4f-41f9-8f17-f11605dcd38f service nova] Acquired lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:10:12 user nova-compute[74587]: DEBUG nova.network.neutron [req-5e17acc8-c4e5-45b7-94fb-99803261d9b4 req-61c3b7ff-ff4f-41f9-8f17-f11605dcd38f service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Refreshing network info cache for port 6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:10:13 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:10:13 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=25.51816177368164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 4ef9e718-1203-413a-909f-b0cf90a5b2b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 205d8114-61a9-4108-9f65-042656ad2a69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance fe149618-b362-4460-84d3-1b8e0e56f2f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance c17be69f-69e9-455c-9f83-5b2851b1d646 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.518s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] <== connect_volume: return (2012ms) {'type': 'block', 'scsi_wwn': '23163316262303261', 'path': '/dev/sdd'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163316262303261', 'path': '/dev/sdd'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzfrwtDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:13 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:13 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:13 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d686848b-3365-421a-82eb-70bb4dd12259]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:10:13 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-5e17acc8-c4e5-45b7-94fb-99803261d9b4 req-61c3b7ff-ff4f-41f9-8f17-f11605dcd38f service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updated VIF entry in instance network info cache for port 6776f41a-346e-45fa-a618-bc4f28583854. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-5e17acc8-c4e5-45b7-94fb-99803261d9b4 req-61c3b7ff-ff4f-41f9-8f17-f11605dcd38f service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updating instance_info_cache with network_info: [{"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0d5dfa-d97f-4ab5-b53e-b3a2f12c41da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae] added
Oct 18 07:10:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5e17acc8-c4e5-45b7-94fb-99803261d9b4 req-61c3b7ff-ff4f-41f9-8f17-f11605dcd38f service nova] Releasing lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e805cfb1-334e-43b5-8a94-06228a98e713]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[06617af7-02d5-4981-8d7a-90d841cc4c28]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FzfrwtDW {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FzfrwtDW" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9cfc2d-9b94-4f28-9668-ab2d675f8eb4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FzfrwtDW'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce64b7d-2e37-419b-87de-068cd91a8144]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b32528-33a4-48b9-8ad6-5bc92ec0b1e0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:13 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:13 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:13 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:13 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f1648e-aafc-4ff2-b082-732dc9d442a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae, portal: 172.16.0.220,3260]
Oct 18 07:10:13 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae, portal: 172.16.0.220,3260] successful.
Oct 18 07:10:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e48fb5b-336c-47f6-b65e-0cc16d6000c3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc3cead-2399-45bd-b58e-6c8aa90e32b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:13 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:13 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:13 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:14 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:14 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:14 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:14 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:10:14 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:10:14 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:10:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.176s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:14 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa84eea-81fb-426d-83df-9450a53b2a74]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:14 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzfrwtDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.521s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] <== connect_volume: return (1522ms) {'type': 'block', 'scsi_wwn': '23132623265653838', 'path': '/dev/sde'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132623265653838', 'path': '/dev/sde'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GrZOAyzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:15 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:15 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:15 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f535ccbb-bc1f-4574-ba47-114de4e40240]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:10:15 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[da81751c-c878-410d-9f76-4e074d29f98e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236] added
Oct 18 07:10:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d390347-a255-4257-8e0f-891380bd385a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3c76e1-29be-46b5-afbf-8a86eab9838e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GrZOAyzI {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GrZOAyzI" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[850b1242-62e4-4477-9927-99ac40caed52]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GrZOAyzI'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f802bd-68f6-4bad-bd06-e86b23aff11f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa86a56-d458-4ce5-a3d9-acf87bc93a8f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[43027fbe-b22e-4470-a002-4475504fa188]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236, portal: 172.16.0.220,3260]
Oct 18 07:10:15 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236, portal: 172.16.0.220,3260] successful.
Oct 18 07:10:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd22592-eece-4f91-8ae7-3840aeb0daa4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ff98ed-ab54-465d-960a-0d3af3f76046]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:15 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d829ce02-8fbd-4a7a-b4d9-422842296485]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GrZOAyzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26362626563393739', 'path': '/dev/sdf'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362626563393739', 'path': '/dev/sdf'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f2:bb,bridge_name='br-int',has_traffic_filtering=True,id=73afc3a4-da0c-42ea-b866-75dc761137d8,network=Network(358d948a-aab7-4619-824f-15b39f8388eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73afc3a4-da') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6c:5e,bridge_name='br-int',has_traffic_filtering=True,id=534bce4c-d08f-4662-978c-432d52603ecf,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap534bce4c-d0') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:45,bridge_name='br-int',has_traffic_filtering=True,id=33ce7796-efa3-4c97-8009-0b2ffb3d18a5,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33ce7796-ef') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:78:f0,bridge_name='br-int',has_traffic_filtering=True,id=afff56e2-e738-461d-8d5b-92152ceb057b,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafff56e2-e7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:43:6f,bridge_name='br-int',has_traffic_filtering=True,id=88116839-4d5e-45d4-98bb-f5ed9d0283d7,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88116839-4d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6e:19,bridge_name='br-int',has_traffic_filtering=True,id=6827f9e4-a725-4c88-8fa8-fc0d65263808,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6827f9e4-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f9:70,bridge_name='br-int',has_traffic_filtering=True,id=f55af884-f2ba-40ec-a51c-493e0f2d8c5f,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55af884-f2') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.objects.instance [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lazy-loading 'pci_devices' on Instance uuid fe149618-b362-4460-84d3-1b8e0e56f2f7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:10:16 user nova-compute[74587]:   <uuid>fe149618-b362-4460-84d3-1b8e0e56f2f7</uuid>
Oct 18 07:10:16 user nova-compute[74587]:   <name>instance-0000000a</name>
Oct 18 07:10:16 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:10:16 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:10:16 user nova-compute[74587]:   <metadata>
Oct 18 07:10:16 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:10:16 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:10:16 user nova-compute[74587]:       <nova:name>tempest-device-tagging-server-1354349224</nova:name>
Oct 18 07:10:16 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:10:11</nova:creationTime>
Oct 18 07:10:16 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:10:16 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:10:16 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:10:16 user nova-compute[74587]:       <nova:owner>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:user uuid="b827f4df3f55456793830f04cd97c728">tempest-TaggedBootDevicesTest_v242-1419293243-project-member</nova:user>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:project uuid="e03b70b00e5240b19b472ca694a97c0c">tempest-TaggedBootDevicesTest_v242-1419293243</nova:project>
Oct 18 07:10:16 user nova-compute[74587]:       </nova:owner>
Oct 18 07:10:16 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:10:16 user nova-compute[74587]:       <nova:ports>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:port uuid="73afc3a4-da0c-42ea-b866-75dc761137d8">
Oct 18 07:10:16 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 18 07:10:16 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:port uuid="534bce4c-d08f-4662-978c-432d52603ecf">
Oct 18 07:10:16 user nova-compute[74587]:           <nova:ip type="fixed" address="10.1.1.100" ipVersion="4"/>
Oct 18 07:10:16 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:port uuid="33ce7796-efa3-4c97-8009-0b2ffb3d18a5">
Oct 18 07:10:16 user nova-compute[74587]:           <nova:ip type="fixed" address="10.1.1.189" ipVersion="4"/>
Oct 18 07:10:16 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:port uuid="afff56e2-e738-461d-8d5b-92152ceb057b">
Oct 18 07:10:16 user nova-compute[74587]:           <nova:ip type="fixed" address="10.1.1.200" ipVersion="4"/>
Oct 18 07:10:16 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:port uuid="88116839-4d5e-45d4-98bb-f5ed9d0283d7">
Oct 18 07:10:16 user nova-compute[74587]:           <nova:ip type="fixed" address="10.1.1.7" ipVersion="4"/>
Oct 18 07:10:16 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:port uuid="6827f9e4-a725-4c88-8fa8-fc0d65263808">
Oct 18 07:10:16 user nova-compute[74587]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 18 07:10:16 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:16 user nova-compute[74587]:         <nova:port uuid="f55af884-f2ba-40ec-a51c-493e0f2d8c5f">
Oct 18 07:10:16 user nova-compute[74587]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 18 07:10:16 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:16 user nova-compute[74587]:       </nova:ports>
Oct 18 07:10:16 user nova-compute[74587]:     </nova:instance>
Oct 18 07:10:16 user nova-compute[74587]:   </metadata>
Oct 18 07:10:16 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:10:16 user nova-compute[74587]:     <system>
Oct 18 07:10:16 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:10:16 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:10:16 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:10:16 user nova-compute[74587]:       <entry name="serial">fe149618-b362-4460-84d3-1b8e0e56f2f7</entry>
Oct 18 07:10:16 user nova-compute[74587]:       <entry name="uuid">fe149618-b362-4460-84d3-1b8e0e56f2f7</entry>
Oct 18 07:10:16 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:10:16 user nova-compute[74587]:     </system>
Oct 18 07:10:16 user nova-compute[74587]:   </sysinfo>
Oct 18 07:10:16 user nova-compute[74587]:   <os>
Oct 18 07:10:16 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:10:16 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:10:16 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:10:16 user nova-compute[74587]:   </os>
Oct 18 07:10:16 user nova-compute[74587]:   <features>
Oct 18 07:10:16 user nova-compute[74587]:     <acpi/>
Oct 18 07:10:16 user nova-compute[74587]:     <apic/>
Oct 18 07:10:16 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:10:16 user nova-compute[74587]:   </features>
Oct 18 07:10:16 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:10:16 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:10:16 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:10:16 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:10:16 user nova-compute[74587]:   </clock>
Oct 18 07:10:16 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:10:16 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:10:16 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:10:16 user nova-compute[74587]:   </cpu>
Oct 18 07:10:16 user nova-compute[74587]:   <devices>
Oct 18 07:10:16 user nova-compute[74587]:     <disk type="file" device="cdrom">
Oct 18 07:10:16 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none"/>
Oct 18 07:10:16 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/fe149618-b362-4460-84d3-1b8e0e56f2f7/disk.config"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="hda" bus="ide"/>
Oct 18 07:10:16 user nova-compute[74587]:     </disk>
Oct 18 07:10:16 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:10:16 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:16 user nova-compute[74587]:       <source dev="/dev/sdd"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:       <serial>60d52911-fe77-4279-ac00-17cf830c6e12</serial>
Oct 18 07:10:16 user nova-compute[74587]:     </disk>
Oct 18 07:10:16 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:10:16 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:16 user nova-compute[74587]:       <source dev="/dev/sde"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:       <serial>a5f216cf-3b7d-4dce-9eb6-49b63181b3ae</serial>
Oct 18 07:10:16 user nova-compute[74587]:     </disk>
Oct 18 07:10:16 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:10:16 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:16 user nova-compute[74587]:       <source dev="/dev/sdf"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="vdc" bus="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:       <serial>e7449dd8-385c-486b-8a80-ce0c79fd4236</serial>
Oct 18 07:10:16 user nova-compute[74587]:     </disk>
Oct 18 07:10:16 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:16 user nova-compute[74587]:       <mac address="fa:16:3e:72:f2:bb"/>
Oct 18 07:10:16 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="tap73afc3a4-da"/>
Oct 18 07:10:16 user nova-compute[74587]:     </interface>
Oct 18 07:10:16 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:16 user nova-compute[74587]:       <mac address="fa:16:3e:8b:6c:5e"/>
Oct 18 07:10:16 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="tap534bce4c-d0"/>
Oct 18 07:10:16 user nova-compute[74587]:     </interface>
Oct 18 07:10:16 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:16 user nova-compute[74587]:       <mac address="fa:16:3e:46:51:45"/>
Oct 18 07:10:16 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="tap33ce7796-ef"/>
Oct 18 07:10:16 user nova-compute[74587]:     </interface>
Oct 18 07:10:16 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:16 user nova-compute[74587]:       <mac address="fa:16:3e:2d:78:f0"/>
Oct 18 07:10:16 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="tapafff56e2-e7"/>
Oct 18 07:10:16 user nova-compute[74587]:     </interface>
Oct 18 07:10:16 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:16 user nova-compute[74587]:       <mac address="fa:16:3e:35:43:6f"/>
Oct 18 07:10:16 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="tap88116839-4d"/>
Oct 18 07:10:16 user nova-compute[74587]:     </interface>
Oct 18 07:10:16 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:16 user nova-compute[74587]:       <mac address="fa:16:3e:c1:6e:19"/>
Oct 18 07:10:16 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="tap6827f9e4-a7"/>
Oct 18 07:10:16 user nova-compute[74587]:     </interface>
Oct 18 07:10:16 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:16 user nova-compute[74587]:       <mac address="fa:16:3e:6b:f9:70"/>
Oct 18 07:10:16 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:16 user nova-compute[74587]:       <target dev="tapf55af884-f2"/>
Oct 18 07:10:16 user nova-compute[74587]:     </interface>
Oct 18 07:10:16 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:10:16 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/fe149618-b362-4460-84d3-1b8e0e56f2f7/console.log" append="off"/>
Oct 18 07:10:16 user nova-compute[74587]:     </serial>
Oct 18 07:10:16 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:10:16 user nova-compute[74587]:     <video>
Oct 18 07:10:16 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:16 user nova-compute[74587]:     </video>
Oct 18 07:10:16 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:10:16 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:10:16 user nova-compute[74587]:     </rng>
Oct 18 07:10:16 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:10:16 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:10:16 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:10:16 user nova-compute[74587]:     </memballoon>
Oct 18 07:10:16 user nova-compute[74587]:   </devices>
Oct 18 07:10:16 user nova-compute[74587]: </domain>
Oct 18 07:10:16 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f2:bb,bridge_name='br-int',has_traffic_filtering=True,id=73afc3a4-da0c-42ea-b866-75dc761137d8,network=Network(358d948a-aab7-4619-824f-15b39f8388eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73afc3a4-da') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f2:bb,bridge_name='br-int',has_traffic_filtering=True,id=73afc3a4-da0c-42ea-b866-75dc761137d8,network=Network(358d948a-aab7-4619-824f-15b39f8388eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73afc3a4-da') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd92774a0-6b7d-5042-b7b9-b63d187fe876', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73afc3a4-da, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73afc3a4-da, col_values=(('qos', UUID('6fadee89-ccae-419b-8f23-ac143be8ed4a')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73afc3a4-da, col_values=(('external_ids', {'iface-id': '73afc3a4-da0c-42ea-b866-75dc761137d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:f2:bb', 'vm-uuid': 'fe149618-b362-4460-84d3-1b8e0e56f2f7'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: INFO os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f2:bb,bridge_name='br-int',has_traffic_filtering=True,id=73afc3a4-da0c-42ea-b866-75dc761137d8,network=Network(358d948a-aab7-4619-824f-15b39f8388eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73afc3a4-da')
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6c:5e,bridge_name='br-int',has_traffic_filtering=True,id=534bce4c-d08f-4662-978c-432d52603ecf,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap534bce4c-d0') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6c:5e,bridge_name='br-int',has_traffic_filtering=True,id=534bce4c-d08f-4662-978c-432d52603ecf,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap534bce4c-d0') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe496bf0-7d99-509c-ad03-dffcf87860e4', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap534bce4c-d0, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap534bce4c-d0, col_values=(('qos', UUID('8201575e-19b8-445f-ba90-5363bd3c4ed2')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap534bce4c-d0, col_values=(('external_ids', {'iface-id': '534bce4c-d08f-4662-978c-432d52603ecf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:6c:5e', 'vm-uuid': 'fe149618-b362-4460-84d3-1b8e0e56f2f7'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: INFO os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6c:5e,bridge_name='br-int',has_traffic_filtering=True,id=534bce4c-d08f-4662-978c-432d52603ecf,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap534bce4c-d0')
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:45,bridge_name='br-int',has_traffic_filtering=True,id=33ce7796-efa3-4c97-8009-0b2ffb3d18a5,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33ce7796-ef') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:45,bridge_name='br-int',has_traffic_filtering=True,id=33ce7796-efa3-4c97-8009-0b2ffb3d18a5,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33ce7796-ef') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29239987-667e-55df-831b-ee4a10836f57', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33ce7796-ef, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33ce7796-ef, col_values=(('qos', UUID('2ecd0cd8-decf-4f39-afd5-59c731635592')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33ce7796-ef, col_values=(('external_ids', {'iface-id': '33ce7796-efa3-4c97-8009-0b2ffb3d18a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:51:45', 'vm-uuid': 'fe149618-b362-4460-84d3-1b8e0e56f2f7'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: INFO os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:45,bridge_name='br-int',has_traffic_filtering=True,id=33ce7796-efa3-4c97-8009-0b2ffb3d18a5,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33ce7796-ef')
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:78:f0,bridge_name='br-int',has_traffic_filtering=True,id=afff56e2-e738-461d-8d5b-92152ceb057b,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafff56e2-e7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:78:f0,bridge_name='br-int',has_traffic_filtering=True,id=afff56e2-e738-461d-8d5b-92152ceb057b,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafff56e2-e7') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81d25c2d-e022-5b6e-b98a-b41f4c7f1bd7', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafff56e2-e7, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafff56e2-e7, col_values=(('qos', UUID('f4da939d-dd5c-44b8-92fd-7e8b107c9d23')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafff56e2-e7, col_values=(('external_ids', {'iface-id': 'afff56e2-e738-461d-8d5b-92152ceb057b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:78:f0', 'vm-uuid': 'fe149618-b362-4460-84d3-1b8e0e56f2f7'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: INFO os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:78:f0,bridge_name='br-int',has_traffic_filtering=True,id=afff56e2-e738-461d-8d5b-92152ceb057b,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafff56e2-e7')
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:43:6f,bridge_name='br-int',has_traffic_filtering=True,id=88116839-4d5e-45d4-98bb-f5ed9d0283d7,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88116839-4d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:43:6f,bridge_name='br-int',has_traffic_filtering=True,id=88116839-4d5e-45d4-98bb-f5ed9d0283d7,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88116839-4d') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2e99fe9-5a44-574c-b7fa-49fa8049f4b6', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88116839-4d, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88116839-4d, col_values=(('qos', UUID('28951058-0032-423c-8534-4ee76192cd06')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88116839-4d, col_values=(('external_ids', {'iface-id': '88116839-4d5e-45d4-98bb-f5ed9d0283d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:43:6f', 'vm-uuid': 'fe149618-b362-4460-84d3-1b8e0e56f2f7'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: INFO os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:43:6f,bridge_name='br-int',has_traffic_filtering=True,id=88116839-4d5e-45d4-98bb-f5ed9d0283d7,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88116839-4d')
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6e:19,bridge_name='br-int',has_traffic_filtering=True,id=6827f9e4-a725-4c88-8fa8-fc0d65263808,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6827f9e4-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6e:19,bridge_name='br-int',has_traffic_filtering=True,id=6827f9e4-a725-4c88-8fa8-fc0d65263808,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6827f9e4-a7') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3295b7cc-1ee6-57a8-9c05-9c897924557a', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6827f9e4-a7, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6827f9e4-a7, col_values=(('qos', UUID('8c088a8c-604a-4699-af5e-f0a5156788f5')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6827f9e4-a7, col_values=(('external_ids', {'iface-id': '6827f9e4-a725-4c88-8fa8-fc0d65263808', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:6e:19', 'vm-uuid': 'fe149618-b362-4460-84d3-1b8e0e56f2f7'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:17 user nova-compute[74587]: INFO os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6e:19,bridge_name='br-int',has_traffic_filtering=True,id=6827f9e4-a725-4c88-8fa8-fc0d65263808,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6827f9e4-a7')
Oct 18 07:10:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f9:70,bridge_name='br-int',has_traffic_filtering=True,id=f55af884-f2ba-40ec-a51c-493e0f2d8c5f,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55af884-f2') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f9:70,bridge_name='br-int',has_traffic_filtering=True,id=f55af884-f2ba-40ec-a51c-493e0f2d8c5f,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55af884-f2') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e83eef6-0e89-5b5f-ae0e-c8d0bbf74c67', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf55af884-f2, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf55af884-f2, col_values=(('qos', UUID('c0520df1-d7a2-4c6b-b499-fa89ac0d28c4')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf55af884-f2, col_values=(('external_ids', {'iface-id': 'f55af884-f2ba-40ec-a51c-493e0f2d8c5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:f9:70', 'vm-uuid': 'fe149618-b362-4460-84d3-1b8e0e56f2f7'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:17 user nova-compute[74587]: INFO os_vif [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f9:70,bridge_name='br-int',has_traffic_filtering=True,id=f55af884-f2ba-40ec-a51c-493e0f2d8c5f,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55af884-f2')
Oct 18 07:10:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] No BDM found with device name hda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] No VIF found with MAC fa:16:3e:72:f2:bb, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] No VIF found with MAC fa:16:3e:35:43:6f, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:10:17 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Using config drive
Oct 18 07:10:17 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Creating config drive at /opt/stack/data/nova/instances/fe149618-b362-4460-84d3-1b8e0e56f2f7/disk.config
Oct 18 07:10:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fe149618-b362-4460-84d3-1b8e0e56f2f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbm0kovgz {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fe149618-b362-4460-84d3-1b8e0e56f2f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbm0kovgz" returned: 0 in 0.058s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-192ada33-d56e-4e08-932a-be539ce77059 req-4dcca797-4db9-4213-8ee4-a848e0214076 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-192ada33-d56e-4e08-932a-be539ce77059 req-4dcca797-4db9-4213-8ee4-a848e0214076 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-192ada33-d56e-4e08-932a-be539ce77059 req-4dcca797-4db9-4213-8ee4-a848e0214076 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-192ada33-d56e-4e08-932a-be539ce77059 req-4dcca797-4db9-4213-8ee4-a848e0214076 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-192ada33-d56e-4e08-932a-be539ce77059 req-4dcca797-4db9-4213-8ee4-a848e0214076 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:19 user nova-compute[74587]: WARNING nova.compute.manager [req-192ada33-d56e-4e08-932a-be539ce77059 req-4dcca797-4db9-4213-8ee4-a848e0214076 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-73afc3a4-da0c-42ea-b866-75dc761137d8 for instance with vm_state building and task_state spawning.
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-e6cb5c0f-8474-4a27-87b2-8d66fe5b292e req-e91bbc27-cf2d-433b-8311-969381c9c282 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e6cb5c0f-8474-4a27-87b2-8d66fe5b292e req-e91bbc27-cf2d-433b-8311-969381c9c282 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e6cb5c0f-8474-4a27-87b2-8d66fe5b292e req-e91bbc27-cf2d-433b-8311-969381c9c282 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e6cb5c0f-8474-4a27-87b2-8d66fe5b292e req-e91bbc27-cf2d-433b-8311-969381c9c282 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-e6cb5c0f-8474-4a27-87b2-8d66fe5b292e req-e91bbc27-cf2d-433b-8311-969381c9c282 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:19 user nova-compute[74587]: WARNING nova.compute.manager [req-e6cb5c0f-8474-4a27-87b2-8d66fe5b292e req-e91bbc27-cf2d-433b-8311-969381c9c282 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 for instance with vm_state building and task_state spawning.
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG nova.compute.manager [req-03605ec0-ef23-4894-b2d3-51141a95c7b2 req-91bdb8f4-942a-4ae9-92f1-54e5056184b8 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-03605ec0-ef23-4894-b2d3-51141a95c7b2 req-91bdb8f4-942a-4ae9-92f1-54e5056184b8 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-03605ec0-ef23-4894-b2d3-51141a95c7b2 req-91bdb8f4-942a-4ae9-92f1-54e5056184b8 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-03605ec0-ef23-4894-b2d3-51141a95c7b2 req-91bdb8f4-942a-4ae9-92f1-54e5056184b8 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG nova.compute.manager [req-03605ec0-ef23-4894-b2d3-51141a95c7b2 req-91bdb8f4-942a-4ae9-92f1-54e5056184b8 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:20 user nova-compute[74587]: WARNING nova.compute.manager [req-03605ec0-ef23-4894-b2d3-51141a95c7b2 req-91bdb8f4-942a-4ae9-92f1-54e5056184b8 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-afff56e2-e738-461d-8d5b-92152ceb057b for instance with vm_state building and task_state spawning.
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:21 user nova-compute[74587]: WARNING nova.compute.manager [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-73afc3a4-da0c-42ea-b866-75dc761137d8 for instance with vm_state building and task_state spawning.
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:21 user nova-compute[74587]: WARNING nova.compute.manager [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-534bce4c-d08f-4662-978c-432d52603ecf for instance with vm_state building and task_state spawning.
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:21 user nova-compute[74587]: WARNING nova.compute.manager [req-f42a9564-bc38-4df4-9e1d-34916c9a26d8 req-4e409d70-282a-4df2-92a4-f059d115c008 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-534bce4c-d08f-4662-978c-432d52603ecf for instance with vm_state building and task_state spawning.
Oct 18 07:10:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:21 user nova-compute[74587]: WARNING nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 for instance with vm_state building and task_state spawning.
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:21 user nova-compute[74587]: WARNING nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 for instance with vm_state building and task_state spawning.
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:21 user nova-compute[74587]: WARNING nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 for instance with vm_state building and task_state spawning.
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:21 user nova-compute[74587]: WARNING nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 for instance with vm_state building and task_state spawning.
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:21 user nova-compute[74587]: WARNING nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 for instance with vm_state building and task_state spawning.
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:21 user nova-compute[74587]: WARNING nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f for instance with vm_state building and task_state spawning.
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:21 user nova-compute[74587]: WARNING nova.compute.manager [req-43f06fd9-14c1-4d5d-8e51-0a7562976283 req-9b611030-bf3e-4f40-ac5a-85dc4bc00292 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f for instance with vm_state building and task_state spawning.
Oct 18 07:10:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:22 user nova-compute[74587]: DEBUG nova.compute.manager [req-436a7cda-fb0c-498e-9df2-e9a641405ec5 req-d4970b33-fb85-4f85-99c4-361f2deb8b5b service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:10:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-436a7cda-fb0c-498e-9df2-e9a641405ec5 req-d4970b33-fb85-4f85-99c4-361f2deb8b5b service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-436a7cda-fb0c-498e-9df2-e9a641405ec5 req-d4970b33-fb85-4f85-99c4-361f2deb8b5b service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-436a7cda-fb0c-498e-9df2-e9a641405ec5 req-d4970b33-fb85-4f85-99c4-361f2deb8b5b service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:22 user nova-compute[74587]: DEBUG nova.compute.manager [req-436a7cda-fb0c-498e-9df2-e9a641405ec5 req-d4970b33-fb85-4f85-99c4-361f2deb8b5b service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:10:22 user nova-compute[74587]: WARNING nova.compute.manager [req-436a7cda-fb0c-498e-9df2-e9a641405ec5 req-d4970b33-fb85-4f85-99c4-361f2deb8b5b service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-afff56e2-e738-461d-8d5b-92152ceb057b for instance with vm_state building and task_state spawning.
Oct 18 07:10:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:10:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:10:23 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Instance spawned successfully.
Oct 18 07:10:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:10:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:10:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:10:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:10:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:10:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:10:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:10:23 user nova-compute[74587]: INFO nova.compute.manager [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Took 11.81 seconds to spawn the instance on the hypervisor.
Oct 18 07:10:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:10:23 user nova-compute[74587]: INFO nova.compute.manager [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Took 93.47 seconds to build instance.
Oct 18 07:10:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ddbda366-0c01-469f-974f-8508d9539e04 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 93.576s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcSkRwPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:31 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:31 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:31 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2231bb7-36fc-4a4d-8f93-8c092ed96443]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:10:31 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[36468dd1-3687-48ee-9a99-0038c7fc2455]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997] added
Oct 18 07:10:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4e67f9-4156-47b8-ad2a-7e3f12d20dde]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c018f8-735f-4880-a46d-cae1a3347801]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcSkRwPK {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.utils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcSkRwPK" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[212dca51-abee-4797-8552-f1de7b1f8f6e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dcSkRwPK'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e0a7e2-c510-44ce-b40f-5e404918f369]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae88a1f-aaaa-42bc-9cdc-e2daae77db6e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9877d5be-c3d8-47ce-9439-9be24420b7de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aaf255-2a1d-4917-af03-4b6bdcd2bf68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dd4e68-cd31-44cd-9dea-8bc68d8cb167]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[42316ee8-3b48-4993-afc5-3dd6bc5c69dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:31 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:31 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:31 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:31 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:31 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:31 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:31 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:31 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:10:31 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4894cc2d-17d6-453d-b628-46640e8f9743]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.utils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating existing volume attachment record: 6d5e0bfb-394e-4f60-af28-f5c58cd28745 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e06c10-95c6-4579-a94c-90bc86d2ac27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997, portal: 172.16.0.220,3260]
Oct 18 07:10:31 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997, portal: 172.16.0.220,3260] successful.
Oct 18 07:10:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94f4cd3-bb69-48cc-8d9e-2ed75e95b72f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc72bb4c-8fed-456d-b84b-912c1e453c42]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:32 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:32 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:32 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:32 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:32 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:32 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:32 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:32 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:32 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:32 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:32 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:32 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f2d9dab7-5b5d-48e1-a23f-3036bca991a8 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.092s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da8b9f-cdf2-4c8c-9681-0131912519a3]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:33 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcSkRwPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:10:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26633666564306132', 'path': '/dev/sdg'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633666564306132', 'path': '/dev/sdg'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:10:33 user nova-compute[74587]: DEBUG nova.objects.instance [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lazy-loading 'flavor' on Instance uuid 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:10:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:10:33 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:33 user nova-compute[74587]:   <source dev="/dev/sdg"/>
Oct 18 07:10:33 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:10:33 user nova-compute[74587]:   <serial>e26d4d6e-01b5-4d64-8c1e-d91f5076d997</serial>
Oct 18 07:10:33 user nova-compute[74587]: </disk>
Oct 18 07:10:33 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:10:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] No VIF found with MAC fa:16:3e:40:00:0f, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:10:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDKIUvay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:44 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:44 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:44 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:10:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f045437b-cbbf-463e-8517-06468d997731]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:10:44 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqfvHMSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:44 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33b91e7-3c1e-419f-aee2-472f30ef70a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb] added
Oct 18 07:10:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a006a29-5648-4adc-ba62-855c2a2750e5]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9174208b-bad7-451a-a9e2-712d4df3c180]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDKIUvay {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDKIUvay" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8f6948-5555-494f-a9ff-63f384459efb]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mDKIUvay'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d8ead9-0871-4ed1-b23a-45abe577f2c7]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8d82fe-05e1-434a-b0a8-ce4f055a4506]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-400f56ea-5ade-4b3f-9f9a-38a8ef46f650 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.058s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e585edaf-5c91-46df-8f5b-9b8727d40b57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260]
Oct 18 07:10:45 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260] successful.
Oct 18 07:10:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabb8bfd-df1e-4291-ac29-a698e5e4c64b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0c4f82-37b8-4e25-932a-af3e3471a5e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:45 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[119147e6-faec-4f6c-ba7c-d2e3d16143ad]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDKIUvay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:10:45 user nova-compute[74587]: INFO nova.compute.manager [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Detaching volume f62d56c1-bf90-4585-b4ca-fd530f6fa470
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.utils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[26124a26-81c9-4e8f-986d-ba425d90f240]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efce69a-ed00-467b-8dfb-2e19d2ba27c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7e85f0-edd9-4332-adac-398ac84f2f0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb5071-7ec6-4122-a3a1-7568f2dc0a6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:10:45 user nova-compute[74587]: INFO nova.virt.block_device [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Attempting to driver detach volume f62d56c1-bf90-4585-b4ca-fd530f6fa470 from mountpoint /dev/sdc
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Attempting to detach device sdc from instance 4ef9e718-1203-413a-909f-b0cf90a5b2b9 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:10:45 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:45 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:10:45 user nova-compute[74587]:   <target dev="sdc" bus="scsi"/>
Oct 18 07:10:45 user nova-compute[74587]:   <serial>f62d56c1-bf90-4585-b4ca-fd530f6fa470</serial>
Oct 18 07:10:45 user nova-compute[74587]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 18 07:10:45 user nova-compute[74587]: </disk>
Oct 18 07:10:45 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:10:45 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a315c-7747-42f2-a47a-183fe58890c4]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG os_brick.utils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updating existing volume attachment record: 3cf09563-ec28-4024-a997-c00a980ae394 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:10:45 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Successfully detached device sdc from instance 4ef9e718-1203-413a-909f-b0cf90a5b2b9 from the persistent domain config.
Oct 18 07:10:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 4ef9e718-1203-413a-909f-b0cf90a5b2b9 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:10:45 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:45 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:10:45 user nova-compute[74587]:   <target dev="sdc" bus="scsi"/>
Oct 18 07:10:45 user nova-compute[74587]:   <serial>f62d56c1-bf90-4585-b4ca-fd530f6fa470</serial>
Oct 18 07:10:45 user nova-compute[74587]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 18 07:10:45 user nova-compute[74587]: </disk>
Oct 18 07:10:45 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 4ef9e718-1203-413a-909f-b0cf90a5b2b9 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:45 user nova-compute[74587]: INFO nova.compute.manager [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Detaching volume 6b6131b2-2f92-496e-98b0-5ab9386bcefd
Oct 18 07:10:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:46 user nova-compute[74587]: INFO nova.virt.block_device [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Attempting to driver detach volume 6b6131b2-2f92-496e-98b0-5ab9386bcefd from mountpoint /dev/vdb
Oct 18 07:10:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Attempting to detach device vdb from instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:10:46 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:46 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:10:46 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:10:46 user nova-compute[74587]:   <serial>6b6131b2-2f92-496e-98b0-5ab9386bcefd</serial>
Oct 18 07:10:46 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 07:10:46 user nova-compute[74587]: </disk>
Oct 18 07:10:46 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:10:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Successfully detached device vdb from instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c from the persistent domain config.
Oct 18 07:10:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:10:46 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:46 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:10:46 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:10:46 user nova-compute[74587]:   <serial>6b6131b2-2f92-496e-98b0-5ab9386bcefd</serial>
Oct 18 07:10:46 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 07:10:46 user nova-compute[74587]: </disk>
Oct 18 07:10:46 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26436633038366161', 'path': '/dev/sdh'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436633038366161', 'path': '/dev/sdh'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.307s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:46 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:46 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lazy-loading 'flavor' on Instance uuid 205d8114-61a9-4108-9f65-042656ad2a69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4055e08b-4573-4973-8a41-86ebff3e1d17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:10:46 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:10:46 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:46 user nova-compute[74587]:   <source dev="/dev/sdh"/>
Oct 18 07:10:46 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:10:46 user nova-compute[74587]:   <serial>a9375339-bbe2-47a4-9083-9ec645a09ecb</serial>
Oct 18 07:10:46 user nova-compute[74587]: </disk>
Oct 18 07:10:46 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5013b3fe-4a2c-4fee-9333-876d1fd8f0c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016] added
Oct 18 07:10:46 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[53948777-8dbc-4f26-b2f9-e90f1284c046]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fec5b3-afe6-4b45-8660-42dfe670a2e7]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqfvHMSj {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqfvHMSj" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f718d7-8bda-4ddb-832f-6e1092f7897f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lqfvHMSj'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[db66b089-630b-4f49-a8c8-c0bb1066433b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[572ace8a-453f-42a0-b3b8-48d49b79151f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:46 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:46 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adc7d60-7d1d-42ae-8c31-608f3140ca15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016, portal: 172.16.0.220,3260]
Oct 18 07:10:46 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016, portal: 172.16.0.220,3260] successful.
Oct 18 07:10:46 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e705f4a-9262-47e7-bb0b-e76ca4296077]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5288c880-9ab0-48df-b6d2-4946a89c4870]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:46 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:46 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a092f926-5dde-48da-ba15-37da028e1448]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqfvHMSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] No VIF found with MAC fa:16:3e:d2:59:28, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:47 user nova-compute[74587]: INFO nova.compute.manager [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Detaching volume e26d4d6e-01b5-4d64-8c1e-d91f5076d997
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3c8f3337-c5f3-4af2-95ff-290caffe8588 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.203s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:47 user nova-compute[74587]: INFO nova.virt.block_device [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Attempting to driver detach volume e26d4d6e-01b5-4d64-8c1e-d91f5076d997 from mountpoint /dev/vdb
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Attempting to detach device vdb from instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:10:47 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:47 user nova-compute[74587]:   <source dev="/dev/sdg"/>
Oct 18 07:10:47 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:10:47 user nova-compute[74587]:   <serial>e26d4d6e-01b5-4d64-8c1e-d91f5076d997</serial>
Oct 18 07:10:47 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:10:47 user nova-compute[74587]: </disk>
Oct 18 07:10:47 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:10:47 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Successfully detached device vdb from instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 from the persistent domain config.
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:10:47 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:47 user nova-compute[74587]:   <source dev="/dev/sdg"/>
Oct 18 07:10:47 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:10:47 user nova-compute[74587]:   <serial>e26d4d6e-01b5-4d64-8c1e-d91f5076d997</serial>
Oct 18 07:10:47 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:10:47 user nova-compute[74587]: </disk>
Oct 18 07:10:47 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] <== connect_volume: return (2680ms) {'type': 'block', 'scsi_wwn': '26234326435393038', 'path': '/dev/sdi'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234326435393038', 'path': '/dev/sdi'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.objects.instance [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lazy-loading 'flavor' on Instance uuid fe0bd998-4fb1-45fc-a2c3-c3486c54754d {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] attach device xml: <disk type="block" device="disk">
Oct 18 07:10:47 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:47 user nova-compute[74587]:   <source dev="/dev/sdi"/>
Oct 18 07:10:47 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:10:47 user nova-compute[74587]:   <serial>b269a736-e0bf-45b7-b758-b99dfb408016</serial>
Oct 18 07:10:47 user nova-compute[74587]: </disk>
Oct 18 07:10:47 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "205d8114-61a9-4108-9f65-042656ad2a69" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG os_brick.utils [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b406af9a-6154-4a89-afdd-f70717648b90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8833069-1118-4934-89a0-d51dcce60ad6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2636ca-748b-4b73-b252-42393f4c8d71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c493928-058c-49b8-8f4a-672bbfc94fbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:10:48 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:10:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa715c0-b45b-411e-b784-fd6f0dfbd31a]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:10:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:10:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:10:48 user nova-compute[74587]: DEBUG os_brick.utils [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:48 user nova-compute[74587]: INFO nova.compute.manager [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Swapping volume a9375339-bbe2-47a4-9083-9ec645a09ecb for b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5
Oct 18 07:10:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] No VIF found with MAC fa:16:3e:5e:72:85, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:10:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53e9e66a-c7cd-4a05-a9d9-e25185830f79 tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 60.190s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:10:52 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Creating image(s)
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Ensure instance console log exists: /opt/stack/data/nova/instances/c17be69f-69e9-455c-9f83-5b2851b1d646/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Start _get_guest_xml network_info=[{"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '082315ee-b041-42d3-8c71-a4bcad48c48f', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OebvFzhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c17be69f-69e9-455c-9f83-5b2851b1d646', 'attached_at': '', 'detached_at': '', 'volume_id': '18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49', 'serial': '18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'bd156a3e-5795-4770-ae6b-8727195311a5', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFZPfjYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c17be69f-69e9-455c-9f83-5b2851b1d646', 'attached_at': '', 'detached_at': '', 'volume_id': '3e76c0dc-dc0c-4508-a142-8aa97ba64e63', 'serial': '3e76c0dc-dc0c-4508-a142-8aa97ba64e63'}, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '6d5e0bfb-394e-4f60-af28-f5c58cd28745', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqfupRZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c17be69f-69e9-455c-9f83-5b2851b1d646', 'attached_at': '', 'detached_at': '', 'volume_id': 'b53ded95-5612-47e8-acd5-1f6846e7e8f8', 'serial': 'b53ded95-5612-47e8-acd5-1f6846e7e8f8'}, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:10:52 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:10:52 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OebvFzhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:52 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:52 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:52 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[51557f0c-f5b0-4691-bbd8-ee9268ef0c75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:10:52 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[413df53b-b73f-4271-b4ef-6099b48d4d52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49] added
Oct 18 07:10:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee7fac8-9d0a-4877-bb88-2d6972c4e5b8]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[82513e95-c83b-40dd-8fa6-891abccfd2f6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OebvFzhX {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OebvFzhX" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[da48c7fb-66a1-4f87-9427-836c9dd8cde1]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OebvFzhX'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[28381439-b718-4d4c-b1b1-6aba7dc2dbcf]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cec5e84-cb8b-4bf1-baf2-5ad5fc591fe6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1955485c-0b5e-4521-a5cb-31326e32c27b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49, portal: 172.16.0.220,3260]
Oct 18 07:10:52 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49, portal: 172.16.0.220,3260] successful.
Oct 18 07:10:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1353ff37-9bff-49c2-8c8d-71b0cc8a25b2]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3d645e-8553-4096-80ce-93db789f849e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:52 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:10:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[950a800b-3f18-45b2-9ac5-8bc5836a8e32]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:53 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OebvFzhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:10:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f60215c7-b8d5-47f5-99fb-76c084121b0a tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] volume_snapshot_create: create_info: {'snapshot_id': '5238b0e9-fcec-4b68-9e66-ba3243f5d6fb', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74587) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 18 07:10:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f60215c7-b8d5-47f5-99fb-76c084121b0a tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] snap xml: <domainsnapshot>
Oct 18 07:10:53 user nova-compute[74587]:   <disks>
Oct 18 07:10:53 user nova-compute[74587]:     <disk name="/dev/sdi" snapshot="external" type="file">
Oct 18 07:10:53 user nova-compute[74587]:       <source file="/dev/new_file"/>
Oct 18 07:10:53 user nova-compute[74587]:     </disk>
Oct 18 07:10:53 user nova-compute[74587]:     <disk name="vda" snapshot="no"/>
Oct 18 07:10:53 user nova-compute[74587]:   </disks>
Oct 18 07:10:53 user nova-compute[74587]: </domainsnapshot>
Oct 18 07:10:53 user nova-compute[74587]:  {{(pid=74587) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 18 07:10:53 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f60215c7-b8d5-47f5-99fb-76c084121b0a tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] Lazy-loading 'system_metadata' on Instance uuid fe0bd998-4fb1-45fc-a2c3-c3486c54754d {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:10:53 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f60215c7-b8d5-47f5-99fb-76c084121b0a tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [None req-f60215c7-b8d5-47f5-99fb-76c084121b0a tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Traceback (most recent call last):
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     rv = execute(f, *args, **kwargs)
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     six.reraise(c, e, tb)
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     raise value
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     rv = meth(*args, **kwargs)
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] 
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [None req-f60215c7-b8d5-47f5-99fb-76c084121b0a tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Traceback (most recent call last):
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     self._volume_snapshot_create(context, instance, guest,
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     rv = execute(f, *args, **kwargs)
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     six.reraise(c, e, tb)
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     raise value
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     rv = meth(*args, **kwargs)
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 07:10:53 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] 
Oct 18 07:10:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9b77cdd8-622a-42f3-966f-b3718de1f343 tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] volume_snapshot_delete: delete_info: {'volume_id': 'b269a736-e0bf-45b7-b758-b99dfb408016'} {{(pid=74587) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [None req-9b77cdd8-622a-42f3-966f-b3718de1f343 tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Traceback (most recent call last):
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d]     if delete_info['type'] != 'qcow2':
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] KeyError: 'type'
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] 
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26337613961626231', 'path': '/dev/sdj'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337613961626231', 'path': '/dev/sdj'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [None req-f60215c7-b8d5-47f5-99fb-76c084121b0a tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 5238b0e9-fcec-4b68-9e66-ba3243f5d6fb could not be found.
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     raise value
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver 
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver 
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 5238b0e9-fcec-4b68-9e66-ba3243f5d6fb could not be found. (HTTP 404) (Request-ID: req-224a2bf4-2832-4785-b6d7-71f1d470b4c4)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver 
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver 
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 5238b0e9-fcec-4b68-9e66-ba3243f5d6fb could not be found.
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver 
Oct 18 07:10:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFZPfjYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:54 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:54 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:54 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver [None req-9b77cdd8-622a-42f3-966f-b3718de1f343 tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver 
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver 
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-c242ceb0-f1b7-479d-83b0-6582d8e8b453)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver 
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver 
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 18 07:10:54 user nova-compute[74587]: ERROR nova.virt.libvirt.driver 
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server [None req-f60215c7-b8d5-47f5-99fb-76c084121b0a tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     raise value
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server 
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b658cc3-cbc8-48e3-b7fb-75bb0291320a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:10:54 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server [None req-9b77cdd8-622a-42f3-966f-b3718de1f343 tempest-VolumesAssistedSnapshotsTest-743883307 tempest-VolumesAssistedSnapshotsTest-743883307-project] Exception during message handling: KeyError: 'type'
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 18 07:10:54 user nova-compute[74587]: ERROR oslo_messaging.rpc.server 
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a316d1fd-68f2-4622-9a94-4c4712da40e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63] added
Oct 18 07:10:54 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[be330d6a-ab75-40e8-9190-0bee7e984f25]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aacbe6d-2498-4bc8-b061-634ffef7015d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFZPfjYc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFZPfjYc" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d9f3f9-8d5c-43a3-9a82-f97683f2aa12]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BFZPfjYc'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb8fe9f-e755-43d6-befb-56e6c11c1cd1]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a9a15c-3bab-4848-8789-e39bd780b97c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Acquiring lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:10:54 user nova-compute[74587]: INFO nova.compute.manager [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Detaching volume b269a736-e0bf-45b7-b758-b99dfb408016
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c610434-9693-436d-a13e-019e79b661e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63, portal: 172.16.0.220,3260]
Oct 18 07:10:54 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63, portal: 172.16.0.220,3260] successful.
Oct 18 07:10:54 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[645a1be2-b819-4f47-bb32-52a02e5ede32]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: INFO nova.virt.block_device [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Attempting to driver detach volume b269a736-e0bf-45b7-b758-b99dfb408016 from mountpoint /dev/vdb
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2c0bc7-4490-4d80-b364-0b56346cd31e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:54 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:54 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Attempting to detach device vdb from instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] detach device xml: <disk type="block" device="disk">
Oct 18 07:10:54 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:54 user nova-compute[74587]:   <source dev="/dev/sdi"/>
Oct 18 07:10:54 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:10:54 user nova-compute[74587]:   <serial>b269a736-e0bf-45b7-b758-b99dfb408016</serial>
Oct 18 07:10:54 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:10:54 user nova-compute[74587]: </disk>
Oct 18 07:10:54 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b586db4-18d4-412a-b52d-cf1bf247ff8f]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:54 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Successfully detached device vdb from instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d from the persistent domain config.
Oct 18 07:10:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] detach device xml: <disk type="block" device="disk">
Oct 18 07:10:54 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:54 user nova-compute[74587]:   <source dev="/dev/sdi"/>
Oct 18 07:10:54 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:10:54 user nova-compute[74587]:   <serial>b269a736-e0bf-45b7-b758-b99dfb408016</serial>
Oct 18 07:10:54 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:10:54 user nova-compute[74587]: </disk>
Oct 18 07:10:54 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:10:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFZPfjYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26531633533303135', 'path': '/dev/sdk'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531633533303135', 'path': '/dev/sdk'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqfupRZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:10:55 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:55 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:10:55 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e47f025-0e96-4bfd-bc42-a3ea3da5a688]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:10:55 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[85213a6c-78d9-4c79-acff-ee3f739be4bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8] added
Oct 18 07:10:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4e1e9f-9b79-4900-b306-62557035002a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[21431eeb-a48b-45c6-b383-d384a32bea10]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqfupRZV {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqfupRZV" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1b6fef-6047-4a21-8ebe-c1bc94c445a7]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqfupRZV'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd778db0-f331-4c7f-8583-791660c329b9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f499d2-de36-4e6f-98db-9d71833ce8c6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:55 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --login" returned: 0 in 1.111s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e35727-c134-4b02-9316-a4759ba42d08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8, portal: 172.16.0.220,3260]
Oct 18 07:10:56 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8, portal: 172.16.0.220,3260] successful.
Oct 18 07:10:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aa86fb-dfc6-493f-bf86-0b35179978e9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[64279841-830d-4ff2-876b-aed928d90976]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:10:56 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:10:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.366s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] HCTL ('43', '-', '-', 0) found on session 12 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[55244461-6be7-47dd-9191-b3f681c9dd96]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Searching for a device in session 12 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:10:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqfupRZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.407s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] <== connect_volume: return (2408ms) {'type': 'block', 'scsi_wwn': '23832326637353765', 'path': '/dev/sdl'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832326637353765', 'path': '/dev/sdl'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2f:c1,bridge_name='br-int',has_traffic_filtering=True,id=04ebae1c-d00a-46dd-8afa-2c8c24c04848,network=Network(77e234c2-b9d9-42f3-8879-5f4244839d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ebae1c-d0') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ae:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ebc9f00-5c') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:1b,bridge_name='br-int',has_traffic_filtering=True,id=74e6c08f-3e16-430b-bc6d-c2ea430c75b2,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74e6c08f-3e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:c3,bridge_name='br-int',has_traffic_filtering=True,id=f194c977-6d80-481e-aee6-31acfc3f10f8,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf194c977-6d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:37:73,bridge_name='br-int',has_traffic_filtering=True,id=2e30d3ed-1d43-4cc9-b452-eeb149c007a7,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30d3ed-1d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d8:95,bridge_name='br-int',has_traffic_filtering=True,id=1ceed310-b30b-4ea9-88d7-6fb43a041bb8,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ceed310-b3') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:17:0e,bridge_name='br-int',has_traffic_filtering=True,id=b48ddaee-bb23-4b91-b54b-9c0ca783f780,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48ddaee-bb') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.objects.instance [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lazy-loading 'pci_devices' on Instance uuid c17be69f-69e9-455c-9f83-5b2851b1d646 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:10:58 user nova-compute[74587]:   <uuid>c17be69f-69e9-455c-9f83-5b2851b1d646</uuid>
Oct 18 07:10:58 user nova-compute[74587]:   <name>instance-0000000b</name>
Oct 18 07:10:58 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:10:58 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:10:58 user nova-compute[74587]:   <metadata>
Oct 18 07:10:58 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:10:58 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:10:58 user nova-compute[74587]:       <nova:name>tempest-device-tagging-server-1049905819</nova:name>
Oct 18 07:10:58 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:10:52</nova:creationTime>
Oct 18 07:10:58 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:10:58 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:10:58 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:10:58 user nova-compute[74587]:       <nova:owner>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:user uuid="04930d45ee104e2f91e46e277bf1f77f">tempest-TaggedBootDevicesTest-150279486-project-member</nova:user>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:project uuid="ba117ef53fc64403ad516a9860cb28f1">tempest-TaggedBootDevicesTest-150279486</nova:project>
Oct 18 07:10:58 user nova-compute[74587]:       </nova:owner>
Oct 18 07:10:58 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:10:58 user nova-compute[74587]:       <nova:ports>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:port uuid="04ebae1c-d00a-46dd-8afa-2c8c24c04848">
Oct 18 07:10:58 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:10:58 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:port uuid="0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f">
Oct 18 07:10:58 user nova-compute[74587]:           <nova:ip type="fixed" address="10.1.1.209" ipVersion="4"/>
Oct 18 07:10:58 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:port uuid="74e6c08f-3e16-430b-bc6d-c2ea430c75b2">
Oct 18 07:10:58 user nova-compute[74587]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Oct 18 07:10:58 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:port uuid="f194c977-6d80-481e-aee6-31acfc3f10f8">
Oct 18 07:10:58 user nova-compute[74587]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Oct 18 07:10:58 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:port uuid="2e30d3ed-1d43-4cc9-b452-eeb149c007a7">
Oct 18 07:10:58 user nova-compute[74587]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Oct 18 07:10:58 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:port uuid="1ceed310-b30b-4ea9-88d7-6fb43a041bb8">
Oct 18 07:10:58 user nova-compute[74587]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 18 07:10:58 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:58 user nova-compute[74587]:         <nova:port uuid="b48ddaee-bb23-4b91-b54b-9c0ca783f780">
Oct 18 07:10:58 user nova-compute[74587]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 18 07:10:58 user nova-compute[74587]:         </nova:port>
Oct 18 07:10:58 user nova-compute[74587]:       </nova:ports>
Oct 18 07:10:58 user nova-compute[74587]:     </nova:instance>
Oct 18 07:10:58 user nova-compute[74587]:   </metadata>
Oct 18 07:10:58 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:10:58 user nova-compute[74587]:     <system>
Oct 18 07:10:58 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:10:58 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:10:58 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:10:58 user nova-compute[74587]:       <entry name="serial">c17be69f-69e9-455c-9f83-5b2851b1d646</entry>
Oct 18 07:10:58 user nova-compute[74587]:       <entry name="uuid">c17be69f-69e9-455c-9f83-5b2851b1d646</entry>
Oct 18 07:10:58 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:10:58 user nova-compute[74587]:     </system>
Oct 18 07:10:58 user nova-compute[74587]:   </sysinfo>
Oct 18 07:10:58 user nova-compute[74587]:   <os>
Oct 18 07:10:58 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:10:58 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:10:58 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:10:58 user nova-compute[74587]:   </os>
Oct 18 07:10:58 user nova-compute[74587]:   <features>
Oct 18 07:10:58 user nova-compute[74587]:     <acpi/>
Oct 18 07:10:58 user nova-compute[74587]:     <apic/>
Oct 18 07:10:58 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:10:58 user nova-compute[74587]:   </features>
Oct 18 07:10:58 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:10:58 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:10:58 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:10:58 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:10:58 user nova-compute[74587]:   </clock>
Oct 18 07:10:58 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:10:58 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:10:58 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:10:58 user nova-compute[74587]:   </cpu>
Oct 18 07:10:58 user nova-compute[74587]:   <devices>
Oct 18 07:10:58 user nova-compute[74587]:     <disk type="file" device="cdrom">
Oct 18 07:10:58 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none"/>
Oct 18 07:10:58 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/c17be69f-69e9-455c-9f83-5b2851b1d646/disk.config"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="hda" bus="ide"/>
Oct 18 07:10:58 user nova-compute[74587]:     </disk>
Oct 18 07:10:58 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:10:58 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:58 user nova-compute[74587]:       <source dev="/dev/sdj"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:       <serial>18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49</serial>
Oct 18 07:10:58 user nova-compute[74587]:     </disk>
Oct 18 07:10:58 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:10:58 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:58 user nova-compute[74587]:       <source dev="/dev/sdk"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:       <serial>3e76c0dc-dc0c-4508-a142-8aa97ba64e63</serial>
Oct 18 07:10:58 user nova-compute[74587]:     </disk>
Oct 18 07:10:58 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:10:58 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:10:58 user nova-compute[74587]:       <source dev="/dev/sdl"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="vdc" bus="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:       <serial>b53ded95-5612-47e8-acd5-1f6846e7e8f8</serial>
Oct 18 07:10:58 user nova-compute[74587]:     </disk>
Oct 18 07:10:58 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:58 user nova-compute[74587]:       <mac address="fa:16:3e:d0:2f:c1"/>
Oct 18 07:10:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="tap04ebae1c-d0"/>
Oct 18 07:10:58 user nova-compute[74587]:     </interface>
Oct 18 07:10:58 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:58 user nova-compute[74587]:       <mac address="fa:16:3e:56:ae:d7"/>
Oct 18 07:10:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="tap0ebc9f00-5c"/>
Oct 18 07:10:58 user nova-compute[74587]:     </interface>
Oct 18 07:10:58 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:58 user nova-compute[74587]:       <mac address="fa:16:3e:a9:3c:1b"/>
Oct 18 07:10:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="tap74e6c08f-3e"/>
Oct 18 07:10:58 user nova-compute[74587]:     </interface>
Oct 18 07:10:58 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:58 user nova-compute[74587]:       <mac address="fa:16:3e:ac:86:c3"/>
Oct 18 07:10:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="tapf194c977-6d"/>
Oct 18 07:10:58 user nova-compute[74587]:     </interface>
Oct 18 07:10:58 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:58 user nova-compute[74587]:       <mac address="fa:16:3e:1c:37:73"/>
Oct 18 07:10:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="tap2e30d3ed-1d"/>
Oct 18 07:10:58 user nova-compute[74587]:     </interface>
Oct 18 07:10:58 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:58 user nova-compute[74587]:       <mac address="fa:16:3e:e2:d8:95"/>
Oct 18 07:10:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="tap1ceed310-b3"/>
Oct 18 07:10:58 user nova-compute[74587]:     </interface>
Oct 18 07:10:58 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:10:58 user nova-compute[74587]:       <mac address="fa:16:3e:e1:17:0e"/>
Oct 18 07:10:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:10:58 user nova-compute[74587]:       <target dev="tapb48ddaee-bb"/>
Oct 18 07:10:58 user nova-compute[74587]:     </interface>
Oct 18 07:10:58 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:10:58 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/c17be69f-69e9-455c-9f83-5b2851b1d646/console.log" append="off"/>
Oct 18 07:10:58 user nova-compute[74587]:     </serial>
Oct 18 07:10:58 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:10:58 user nova-compute[74587]:     <video>
Oct 18 07:10:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:10:58 user nova-compute[74587]:     </video>
Oct 18 07:10:58 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:10:58 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:10:58 user nova-compute[74587]:     </rng>
Oct 18 07:10:58 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:10:58 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:10:58 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:10:58 user nova-compute[74587]:     </memballoon>
Oct 18 07:10:58 user nova-compute[74587]:   </devices>
Oct 18 07:10:58 user nova-compute[74587]: </domain>
Oct 18 07:10:58 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2f:c1,bridge_name='br-int',has_traffic_filtering=True,id=04ebae1c-d00a-46dd-8afa-2c8c24c04848,network=Network(77e234c2-b9d9-42f3-8879-5f4244839d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ebae1c-d0') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2f:c1,bridge_name='br-int',has_traffic_filtering=True,id=04ebae1c-d00a-46dd-8afa-2c8c24c04848,network=Network(77e234c2-b9d9-42f3-8879-5f4244839d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ebae1c-d0') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b13b37f9-c563-55bc-a09f-6cace8fcd858', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04ebae1c-d0, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04ebae1c-d0, col_values=(('qos', UUID('29746622-8413-49de-918d-b86dfc40609f')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04ebae1c-d0, col_values=(('external_ids', {'iface-id': '04ebae1c-d00a-46dd-8afa-2c8c24c04848', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:2f:c1', 'vm-uuid': 'c17be69f-69e9-455c-9f83-5b2851b1d646'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: INFO os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2f:c1,bridge_name='br-int',has_traffic_filtering=True,id=04ebae1c-d00a-46dd-8afa-2c8c24c04848,network=Network(77e234c2-b9d9-42f3-8879-5f4244839d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ebae1c-d0')
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ae:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ebc9f00-5c') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ae:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ebc9f00-5c') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb156899-9f6a-55d7-8f86-b9f0661d1004', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ebc9f00-5c, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ebc9f00-5c, col_values=(('qos', UUID('64b821b3-9061-480d-a316-b702c360a1fb')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ebc9f00-5c, col_values=(('external_ids', {'iface-id': '0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:ae:d7', 'vm-uuid': 'c17be69f-69e9-455c-9f83-5b2851b1d646'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: INFO os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ae:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ebc9f00-5c')
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:1b,bridge_name='br-int',has_traffic_filtering=True,id=74e6c08f-3e16-430b-bc6d-c2ea430c75b2,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74e6c08f-3e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:1b,bridge_name='br-int',has_traffic_filtering=True,id=74e6c08f-3e16-430b-bc6d-c2ea430c75b2,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74e6c08f-3e') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ccb6299-e45e-53a2-9a32-782e9acc89f8', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74e6c08f-3e, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74e6c08f-3e, col_values=(('qos', UUID('b1b3fc7a-54bb-447f-899e-69161aced52e')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74e6c08f-3e, col_values=(('external_ids', {'iface-id': '74e6c08f-3e16-430b-bc6d-c2ea430c75b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:3c:1b', 'vm-uuid': 'c17be69f-69e9-455c-9f83-5b2851b1d646'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: INFO os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:1b,bridge_name='br-int',has_traffic_filtering=True,id=74e6c08f-3e16-430b-bc6d-c2ea430c75b2,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74e6c08f-3e')
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:c3,bridge_name='br-int',has_traffic_filtering=True,id=f194c977-6d80-481e-aee6-31acfc3f10f8,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf194c977-6d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:c3,bridge_name='br-int',has_traffic_filtering=True,id=f194c977-6d80-481e-aee6-31acfc3f10f8,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf194c977-6d') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60f78317-ce8b-5cb4-9754-e4f2151d1805', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf194c977-6d, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf194c977-6d, col_values=(('qos', UUID('ebd08164-afc6-4ed1-bcdd-57d83fe79cb3')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf194c977-6d, col_values=(('external_ids', {'iface-id': 'f194c977-6d80-481e-aee6-31acfc3f10f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:86:c3', 'vm-uuid': 'c17be69f-69e9-455c-9f83-5b2851b1d646'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: INFO os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:c3,bridge_name='br-int',has_traffic_filtering=True,id=f194c977-6d80-481e-aee6-31acfc3f10f8,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf194c977-6d')
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:37:73,bridge_name='br-int',has_traffic_filtering=True,id=2e30d3ed-1d43-4cc9-b452-eeb149c007a7,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30d3ed-1d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:37:73,bridge_name='br-int',has_traffic_filtering=True,id=2e30d3ed-1d43-4cc9-b452-eeb149c007a7,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30d3ed-1d') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80db4f69-0050-5521-8a97-be51c4d72f18', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e30d3ed-1d, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e30d3ed-1d, col_values=(('qos', UUID('14e9d991-80c6-4641-be41-825e9ed59715')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e30d3ed-1d, col_values=(('external_ids', {'iface-id': '2e30d3ed-1d43-4cc9-b452-eeb149c007a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:37:73', 'vm-uuid': 'c17be69f-69e9-455c-9f83-5b2851b1d646'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: INFO os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:37:73,bridge_name='br-int',has_traffic_filtering=True,id=2e30d3ed-1d43-4cc9-b452-eeb149c007a7,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30d3ed-1d')
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d8:95,bridge_name='br-int',has_traffic_filtering=True,id=1ceed310-b30b-4ea9-88d7-6fb43a041bb8,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ceed310-b3') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d8:95,bridge_name='br-int',has_traffic_filtering=True,id=1ceed310-b30b-4ea9-88d7-6fb43a041bb8,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ceed310-b3') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a93c6a7-b5c3-57d5-b68b-bb9dfa59d66b', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ceed310-b3, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ceed310-b3, col_values=(('qos', UUID('8531a45c-0f49-401f-a7f8-4e7525cac9d0')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ceed310-b3, col_values=(('external_ids', {'iface-id': '1ceed310-b30b-4ea9-88d7-6fb43a041bb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:d8:95', 'vm-uuid': 'c17be69f-69e9-455c-9f83-5b2851b1d646'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: INFO os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d8:95,bridge_name='br-int',has_traffic_filtering=True,id=1ceed310-b30b-4ea9-88d7-6fb43a041bb8,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ceed310-b3')
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:17:0e,bridge_name='br-int',has_traffic_filtering=True,id=b48ddaee-bb23-4b91-b54b-9c0ca783f780,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48ddaee-bb') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:17:0e,bridge_name='br-int',has_traffic_filtering=True,id=b48ddaee-bb23-4b91-b54b-9c0ca783f780,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48ddaee-bb') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '847a62c0-5844-5a2c-82e0-2b7f6c6f4b0b', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb48ddaee-bb, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb48ddaee-bb, col_values=(('qos', UUID('021860db-269b-4d68-9592-cd3e8173e5c1')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb48ddaee-bb, col_values=(('external_ids', {'iface-id': 'b48ddaee-bb23-4b91-b54b-9c0ca783f780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:17:0e', 'vm-uuid': 'c17be69f-69e9-455c-9f83-5b2851b1d646'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:10:58 user nova-compute[74587]: INFO os_vif [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:17:0e,bridge_name='br-int',has_traffic_filtering=True,id=b48ddaee-bb23-4b91-b54b-9c0ca783f780,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48ddaee-bb')
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] No BDM found with device name hda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] No VIF found with MAC fa:16:3e:d0:2f:c1, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:10:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] No VIF found with MAC fa:16:3e:1c:37:73, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:10:58 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Using config drive
Oct 18 07:10:59 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Creating config drive at /opt/stack/data/nova/instances/c17be69f-69e9-455c-9f83-5b2851b1d646/disk.config
Oct 18 07:10:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c17be69f-69e9-455c-9f83-5b2851b1d646/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbovj6dlf {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:10:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c17be69f-69e9-455c-9f83-5b2851b1d646/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbovj6dlf" returned: 0 in 0.060s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-e270fd83-c777-4c35-8d2b-74bd64a0984d req-c080dbd7-c56c-4509-a852-f0b88a2cd0d1 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e270fd83-c777-4c35-8d2b-74bd64a0984d req-c080dbd7-c56c-4509-a852-f0b88a2cd0d1 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e270fd83-c777-4c35-8d2b-74bd64a0984d req-c080dbd7-c56c-4509-a852-f0b88a2cd0d1 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e270fd83-c777-4c35-8d2b-74bd64a0984d req-c080dbd7-c56c-4509-a852-f0b88a2cd0d1 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-e270fd83-c777-4c35-8d2b-74bd64a0984d req-c080dbd7-c56c-4509-a852-f0b88a2cd0d1 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:00 user nova-compute[74587]: WARNING nova.compute.manager [req-e270fd83-c777-4c35-8d2b-74bd64a0984d req-c080dbd7-c56c-4509-a852-f0b88a2cd0d1 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 for instance with vm_state building and task_state spawning.
Oct 18 07:11:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-19831e1a-1031-4a33-b9d9-483b3ccc4680 req-8b456d1b-7e29-4e0b-83a0-98284e1bbb94 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-19831e1a-1031-4a33-b9d9-483b3ccc4680 req-8b456d1b-7e29-4e0b-83a0-98284e1bbb94 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-19831e1a-1031-4a33-b9d9-483b3ccc4680 req-8b456d1b-7e29-4e0b-83a0-98284e1bbb94 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-19831e1a-1031-4a33-b9d9-483b3ccc4680 req-8b456d1b-7e29-4e0b-83a0-98284e1bbb94 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-19831e1a-1031-4a33-b9d9-483b3ccc4680 req-8b456d1b-7e29-4e0b-83a0-98284e1bbb94 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:01 user nova-compute[74587]: WARNING nova.compute.manager [req-19831e1a-1031-4a33-b9d9-483b3ccc4680 req-8b456d1b-7e29-4e0b-83a0-98284e1bbb94 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f for instance with vm_state building and task_state spawning.
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-f8dbcf92-39d7-46a8-820f-a14b4e85aecc req-5f4dcaaa-ab58-4ebd-b03a-dc2c2d93a5ab service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f8dbcf92-39d7-46a8-820f-a14b4e85aecc req-5f4dcaaa-ab58-4ebd-b03a-dc2c2d93a5ab service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f8dbcf92-39d7-46a8-820f-a14b4e85aecc req-5f4dcaaa-ab58-4ebd-b03a-dc2c2d93a5ab service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f8dbcf92-39d7-46a8-820f-a14b4e85aecc req-5f4dcaaa-ab58-4ebd-b03a-dc2c2d93a5ab service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-f8dbcf92-39d7-46a8-820f-a14b4e85aecc req-5f4dcaaa-ab58-4ebd-b03a-dc2c2d93a5ab service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:01 user nova-compute[74587]: WARNING nova.compute.manager [req-f8dbcf92-39d7-46a8-820f-a14b4e85aecc req-5f4dcaaa-ab58-4ebd-b03a-dc2c2d93a5ab service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-f194c977-6d80-481e-aee6-31acfc3f10f8 for instance with vm_state building and task_state spawning.
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-c44b2abe-2a94-4df5-a5a5-4ddb269a0ed7 req-75c5a8bb-fe12-4c89-b219-350e19865103 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c44b2abe-2a94-4df5-a5a5-4ddb269a0ed7 req-75c5a8bb-fe12-4c89-b219-350e19865103 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c44b2abe-2a94-4df5-a5a5-4ddb269a0ed7 req-75c5a8bb-fe12-4c89-b219-350e19865103 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c44b2abe-2a94-4df5-a5a5-4ddb269a0ed7 req-75c5a8bb-fe12-4c89-b219-350e19865103 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-c44b2abe-2a94-4df5-a5a5-4ddb269a0ed7 req-75c5a8bb-fe12-4c89-b219-350e19865103 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:02 user nova-compute[74587]: WARNING nova.compute.manager [req-c44b2abe-2a94-4df5-a5a5-4ddb269a0ed7 req-75c5a8bb-fe12-4c89-b219-350e19865103 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 for instance with vm_state building and task_state spawning.
Oct 18 07:11:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:03 user nova-compute[74587]: WARNING nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f for instance with vm_state building and task_state spawning.
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:03 user nova-compute[74587]: WARNING nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 for instance with vm_state building and task_state spawning.
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:03 user nova-compute[74587]: WARNING nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 for instance with vm_state building and task_state spawning.
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:03 user nova-compute[74587]: WARNING nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 for instance with vm_state building and task_state spawning.
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:03 user nova-compute[74587]: WARNING nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 for instance with vm_state building and task_state spawning.
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:03 user nova-compute[74587]: WARNING nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 for instance with vm_state building and task_state spawning.
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:03 user nova-compute[74587]: WARNING nova.compute.manager [req-a29c2058-7864-4840-bd27-7cf18eb2f526 req-eec77429-5f95-4693-9073-f8a08c043088 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 for instance with vm_state building and task_state spawning.
Oct 18 07:11:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:03 user nova-compute[74587]: WARNING nova.compute.manager [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-f194c977-6d80-481e-aee6-31acfc3f10f8 for instance with vm_state building and task_state spawning.
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:03 user nova-compute[74587]: WARNING nova.compute.manager [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 for instance with vm_state building and task_state spawning.
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:03 user nova-compute[74587]: WARNING nova.compute.manager [req-b5fde9bd-ba6d-4753-88db-0d3014d1ad75 req-8e5b937d-7e38-4c57-a796-6f182a3bd29c service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 for instance with vm_state building and task_state spawning.
Oct 18 07:11:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:11:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:11:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:11:05 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Instance spawned successfully.
Oct 18 07:11:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:05 user nova-compute[74587]: INFO nova.compute.manager [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Took 12.60 seconds to spawn the instance on the hypervisor.
Oct 18 07:11:05 user nova-compute[74587]: DEBUG nova.compute.manager [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:11:05 user nova-compute[74587]: INFO nova.compute.manager [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Took 119.34 seconds to build instance.
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-243da8a2-2209-4ffd-aeb3-a6f3a6cad0aa tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 119.470s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:11:05 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 4ef9e718-1203-413a-909f-b0cf90a5b2b9 is timed out.
Oct 18 07:11:05 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Successfully detached device sdc from instance 4ef9e718-1203-413a-909f-b0cf90a5b2b9 from the live domain config.
Oct 18 07:11:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKkiDUHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:05 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b48a6b-9799-4a81-8ab2-357ee2cbc6c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:11:05 user nova-compute[74587]: No targets found.
Oct 18 07:11:05 user nova-compute[74587]: iSNS:
Oct 18 07:11:05 user nova-compute[74587]: No targets found.
Oct 18 07:11:05 user nova-compute[74587]: STATIC:
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:11:05 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:05 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:05 user nova-compute[74587]: FIRMWARE:
Oct 18 07:11:05 user nova-compute[74587]: No targets found.
Oct 18 07:11:05 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:11:05 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:11:05 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[55312457-7a23-4cc5-814c-192a262d1408]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[543f11a3-9a37-4e2f-941c-be63c7a4d47a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:05 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:05 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1008657f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d412faec-e63d-4f90-80c9-93625d9aa19e]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:05 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c6487a-41a0-457d-8ef1-0f61ef255a24]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7c1edb-ce60-4348-a13c-e4ace2e8a031]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa58e3-7232-48fd-9e08-1232c456bca6]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[08200fe0-c8ba-4247-96e0-c75edb9d443d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b169d075-2b5b-4096-8613-230369b8dabe]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470, portal: 172.16.0.220,3260]
Oct 18 07:11:06 user nova-compute[74587]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:06 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f62d56c1-bf90-4585-b4ca-fd530f6fa470 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f579f5-9b04-4a11-a10e-2c83190cc9c5]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] <== disconnect_volume: return (393ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:11:06 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c is timed out.
Oct 18 07:11:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Successfully detached device vdb from instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c from the live domain config.
Oct 18 07:11:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKfCMtli', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:06 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a53b166-3514-489b-b36d-789045bb8860]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:11:06 user nova-compute[74587]: No targets found.
Oct 18 07:11:06 user nova-compute[74587]: iSNS:
Oct 18 07:11:06 user nova-compute[74587]: No targets found.
Oct 18 07:11:06 user nova-compute[74587]: STATIC:
Oct 18 07:11:06 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd
Oct 18 07:11:06 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:06 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:06 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997
Oct 18 07:11:06 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:06 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:06 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236
Oct 18 07:11:06 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:06 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:06 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016
Oct 18 07:11:06 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:06 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:06 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12
Oct 18 07:11:06 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:06 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:06 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb
Oct 18 07:11:06 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:06 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:06 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:11:06 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:06 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:06 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:11:06 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:06 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:06 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae
Oct 18 07:11:06 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:06 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:06 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:11:06 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:06 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:06 user nova-compute[74587]: FIRMWARE:
Oct 18 07:11:06 user nova-compute[74587]: No targets found.
Oct 18 07:11:06 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:11:06 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:11:06 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d69607-d6c9-446b-9084-a573a23bb416]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c712ec-5dc7-4ea5-90a9-63838e5fd468]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:06 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:06 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1008232a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd'): ({'sdc'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Removing single pathed devices sdc {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e756db4-d750-4476-bf96-a9843000f121]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1310c42-c94e-407f-9b8c-fca7acc20ba9]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Flushing IO for device /dev/sdc {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e730f48-dfe3-41a6-b1d6-a07831b59b16]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63feb36-8b0b-4836-9252-91f9336684fc]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f57ca2-8eab-46b3-98a4-d197486a7e6c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2f4db8-9401-47c5-a2de-879c0a62edc5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd, portal: 172.16.0.220,3260]
Oct 18 07:11:06 user nova-compute[74587]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:06 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6131b2-2f92-496e-98b0-5ab9386bcefd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd2afb-fc49-4e27-a011-d34d2cf734dc]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] <== disconnect_volume: return (349ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:11:07 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 is timed out.
Oct 18 07:11:07 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Successfully detached device vdb from instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 from the live domain config.
Oct 18 07:11:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcSkRwPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:07 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[72523ba8-7a54-4575-856e-290e485267c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:11:07 user nova-compute[74587]: No targets found.
Oct 18 07:11:07 user nova-compute[74587]: iSNS:
Oct 18 07:11:07 user nova-compute[74587]: No targets found.
Oct 18 07:11:07 user nova-compute[74587]: STATIC:
Oct 18 07:11:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997
Oct 18 07:11:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236
Oct 18 07:11:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016
Oct 18 07:11:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12
Oct 18 07:11:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb
Oct 18 07:11:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:11:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:11:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae
Oct 18 07:11:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:11:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:07 user nova-compute[74587]: FIRMWARE:
Oct 18 07:11:07 user nova-compute[74587]: No targets found.
Oct 18 07:11:07 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:11:07 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:11:07 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e412a6-fb59-40c0-ac87-477a894ad2ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26f1100-0277-43fc-a673-d6c3bd80b81d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:07 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:07 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4656b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997'): ({'sdg'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Removing single pathed devices sdg {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9996a21-2fb6-44c4-9476-ad3f7a66bc2c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95c68e-4c9d-43e8-b980-89176b414819]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Flushing IO for device /dev/sdg {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b310ce5a-cb4f-40f7-8c05-0f4716152b56]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab15815-fe33-4bdd-a82e-486c717f4a3d]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] SCSI volumes sdg have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaabd59-737b-4345-8a53-c3121b07d05e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5ca5cd-b92b-43d5-9495-b0a07e690f33]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997, portal: 172.16.0.220,3260]
Oct 18 07:11:08 user nova-compute[74587]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e26d4d6e-01b5-4d64-8c1e-d91f5076d997 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e01142-572f-489c-8b66-bf76265f6602]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] <== disconnect_volume: return (373ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:08 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating instance_info_cache with network_info: [{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znsvVUtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '205d8114-61a9-4108-9f65-042656ad2a69', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 'serial': 'b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDKIUvay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '205d8114-61a9-4108-9f65-042656ad2a69', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9375339-bbe2-47a4-9083-9ec645a09ecb', 'serial'} {{(pid=74587) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znsvVUtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:09 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:09 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:09 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a103c19-0194-4e2a-b7dd-92f991dead6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:11:09 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaef044-d8ba-4a87-b327-77e10ede22ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5] added
Oct 18 07:11:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f927d18d-15f7-40c0-a134-dc0e546cc28a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[10774218-c78e-438d-8952-4c9cdc79de43]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znsvVUtZ {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znsvVUtZ" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[46192ee6-343e-4c1d-b4f8-2c70a7ee7d76]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'znsvVUtZ'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8832dc19-d801-459c-ae33-32d0ffbad8f4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d81fe4-ae5e-4b45-b57d-cf9ae1910feb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.368s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d4abf1-e6bf-478b-8f7a-40405ab54d4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5, portal: 172.16.0.220,3260]
Oct 18 07:11:09 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b6cdd5-c40e-4957-ae8d-2a259981eb80]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54bed40-56bb-451f-b3c9-3c80921ea623]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:09 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.689s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df1c973-614b-4d45-b39f-1d181ba3c0d1]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:11:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znsvVUtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lazy-loading 'flavor' on Instance uuid 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3a10744c-95a6-4d96-ad2e-8aa08a450e8d tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.965s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.756s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] <== connect_volume: return (1762ms) {'type': 'block', 'scsi_wwn': '23439383130666538', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439383130666538', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:11:10 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lazy-loading 'flavor' on Instance uuid 205d8114-61a9-4108-9f65-042656ad2a69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.objects.instance [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lazy-loading 'flavor' on Instance uuid 4ef9e718-1203-413a-909f-b0cf90a5b2b9 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9386c1be-b89f-4266-a192-ce8cec0e09c1 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.839s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "interface-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-7a367dbf-bcb5-437b-bd09-626f377a43da" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "interface-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-7a367dbf-bcb5-437b-bd09-626f377a43da" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lazy-loading 'flavor' on Instance uuid 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-675565366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-675565366',id=7,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEO5dx++IX4ljOuW+qNj5hpC2x51PQ/SXgUWZY1ekvFYqfyCilmR4DC2lOZdcQco8cKcpkEKyVcg6SoQUuKw0WDM3TFiS+hwHnBjz0Ph4sNwOOd+murzzpvCJKAO0syDw==',key_name='tempest-keypair-1735451947',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='884f75b337bf4ab5b239e3e1e16954ed',ramdisk_id='',reservation_id='r-6o10505b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-259044806',owner_user_name='tempest-TaggedAttachmentsTest-259044806-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42bc78aefa2847238a3b25da59c9a148',uuid=2c672325-def3-49a9-a7b2-9dfb4fa0ce2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a367dbf-bcb5-437b-bd09-626f377a43da", "address": "fa:16:3e:0e:4e:e8", "network": {"id": "8442b85a-b072-41ed-86fd-ec9e6b3f2f4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-873154978", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a367dbf-bc", "ovs_interfaceid": "7a367dbf-bcb5-437b-bd09-626f377a43da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converting VIF {"id": "7a367dbf-bcb5-437b-bd09-626f377a43da", "address": "fa:16:3e:0e:4e:e8", "network": {"id": "8442b85a-b072-41ed-86fd-ec9e6b3f2f4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-873154978", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a367dbf-bc", "ovs_interfaceid": "7a367dbf-bcb5-437b-bd09-626f377a43da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4e:e8,bridge_name='br-int',has_traffic_filtering=True,id=7a367dbf-bcb5-437b-bd09-626f377a43da,network=Network(8442b85a-b072-41ed-86fd-ec9e6b3f2f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a367dbf-bc') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:4e:e8"/><model type="virtio"/><mtu size="1442"/><target dev="tap7a367dbf-bc"/></interface> {{(pid=74587) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:4e:e8"/><model type="virtio"/><mtu size="1442"/><target dev="tap7a367dbf-bc"/></interface> {{(pid=74587) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Attempting to detach device tap7a367dbf-bc from instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] detach device xml: <interface type="ethernet">
Oct 18 07:11:11 user nova-compute[74587]:   <mac address="fa:16:3e:0e:4e:e8"/>
Oct 18 07:11:11 user nova-compute[74587]:   <model type="virtio"/>
Oct 18 07:11:11 user nova-compute[74587]:   <mtu size="1442"/>
Oct 18 07:11:11 user nova-compute[74587]:   <target dev="tap7a367dbf-bc"/>
Oct 18 07:11:11 user nova-compute[74587]: </interface>
Oct 18 07:11:11 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:4e:e8"/><model type="virtio"/><mtu size="1442"/><target dev="tap7a367dbf-bc"/></interface> {{(pid=74587) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:4e:e8"/><model type="virtio"/><mtu size="1442"/><target dev="tap7a367dbf-bc"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 18 07:11:11 user nova-compute[74587]:   <name>instance-00000007</name>
Oct 18 07:11:11 user nova-compute[74587]:   <uuid>2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</uuid>
Oct 18 07:11:11 user nova-compute[74587]:   <metadata>
Oct 18 07:11:11 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:11:11 user nova-compute[74587]:   <nova:package version="0.0.0"/>
Oct 18 07:11:11 user nova-compute[74587]:   <nova:name>tempest-device-tagging-server-675565366</nova:name>
Oct 18 07:11:11 user nova-compute[74587]:   <nova:creationTime>2023-10-18 07:09:40</nova:creationTime>
Oct 18 07:11:11 user nova-compute[74587]:   <nova:flavor name="m1.tiny">
Oct 18 07:11:11 user nova-compute[74587]:     <nova:memory>512</nova:memory>
Oct 18 07:11:11 user nova-compute[74587]:     <nova:disk>1</nova:disk>
Oct 18 07:11:11 user nova-compute[74587]:     <nova:swap>0</nova:swap>
Oct 18 07:11:11 user nova-compute[74587]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:11:11 user nova-compute[74587]:     <nova:vcpus>1</nova:vcpus>
Oct 18 07:11:11 user nova-compute[74587]:   </nova:flavor>
Oct 18 07:11:11 user nova-compute[74587]:   <nova:owner>
Oct 18 07:11:11 user nova-compute[74587]:     <nova:user uuid="42bc78aefa2847238a3b25da59c9a148">tempest-TaggedAttachmentsTest-259044806-project-member</nova:user>
Oct 18 07:11:11 user nova-compute[74587]:     <nova:project uuid="884f75b337bf4ab5b239e3e1e16954ed">tempest-TaggedAttachmentsTest-259044806</nova:project>
Oct 18 07:11:11 user nova-compute[74587]:   </nova:owner>
Oct 18 07:11:11 user nova-compute[74587]:   <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:11:11 user nova-compute[74587]:   <nova:ports>
Oct 18 07:11:11 user nova-compute[74587]:     <nova:port uuid="ddbc6964-8191-4483-8a63-2c853584be6f">
Oct 18 07:11:11 user nova-compute[74587]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 07:11:11 user nova-compute[74587]:     </nova:port>
Oct 18 07:11:11 user nova-compute[74587]:     <nova:port uuid="7a367dbf-bcb5-437b-bd09-626f377a43da">
Oct 18 07:11:11 user nova-compute[74587]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Oct 18 07:11:11 user nova-compute[74587]:     </nova:port>
Oct 18 07:11:11 user nova-compute[74587]:   </nova:ports>
Oct 18 07:11:11 user nova-compute[74587]: </nova:instance>
Oct 18 07:11:11 user nova-compute[74587]:   </metadata>
Oct 18 07:11:11 user nova-compute[74587]:   <memory unit='KiB'>524288</memory>
Oct 18 07:11:11 user nova-compute[74587]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 18 07:11:11 user nova-compute[74587]:   <vcpu placement='static'>1</vcpu>
Oct 18 07:11:11 user nova-compute[74587]:   <resource>
Oct 18 07:11:11 user nova-compute[74587]:     <partition>/machine</partition>
Oct 18 07:11:11 user nova-compute[74587]:   </resource>
Oct 18 07:11:11 user nova-compute[74587]:   <sysinfo type='smbios'>
Oct 18 07:11:11 user nova-compute[74587]:     <system>
Oct 18 07:11:11 user nova-compute[74587]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 18 07:11:11 user nova-compute[74587]:       <entry name='product'>OpenStack Nova</entry>
Oct 18 07:11:11 user nova-compute[74587]:       <entry name='version'>0.0.0</entry>
Oct 18 07:11:11 user nova-compute[74587]:       <entry name='serial'>2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</entry>
Oct 18 07:11:11 user nova-compute[74587]:       <entry name='uuid'>2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</entry>
Oct 18 07:11:11 user nova-compute[74587]:       <entry name='family'>Virtual Machine</entry>
Oct 18 07:11:11 user nova-compute[74587]:     </system>
Oct 18 07:11:11 user nova-compute[74587]:   </sysinfo>
Oct 18 07:11:11 user nova-compute[74587]:   <os>
Oct 18 07:11:11 user nova-compute[74587]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 18 07:11:11 user nova-compute[74587]:     <boot dev='hd'/>
Oct 18 07:11:11 user nova-compute[74587]:     <smbios mode='sysinfo'/>
Oct 18 07:11:11 user nova-compute[74587]:   </os>
Oct 18 07:11:11 user nova-compute[74587]:   <features>
Oct 18 07:11:11 user nova-compute[74587]:     <acpi/>
Oct 18 07:11:11 user nova-compute[74587]:     <apic/>
Oct 18 07:11:11 user nova-compute[74587]:     <vmcoreinfo state='on'/>
Oct 18 07:11:11 user nova-compute[74587]:   </features>
Oct 18 07:11:11 user nova-compute[74587]:   <cpu mode='custom' match='exact' check='full'>
Oct 18 07:11:11 user nova-compute[74587]:     <model fallback='forbid'>Nehalem</model>
Oct 18 07:11:11 user nova-compute[74587]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 18 07:11:11 user nova-compute[74587]:     <feature policy='require' name='vme'/>
Oct 18 07:11:11 user nova-compute[74587]:     <feature policy='require' name='x2apic'/>
Oct 18 07:11:11 user nova-compute[74587]:     <feature policy='require' name='hypervisor'/>
Oct 18 07:11:11 user nova-compute[74587]:   </cpu>
Oct 18 07:11:11 user nova-compute[74587]:   <clock offset='utc'>
Oct 18 07:11:11 user nova-compute[74587]:     <timer name='pit' tickpolicy='delay'/>
Oct 18 07:11:11 user nova-compute[74587]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 18 07:11:11 user nova-compute[74587]:     <timer name='hpet' present='no'/>
Oct 18 07:11:11 user nova-compute[74587]:   </clock>
Oct 18 07:11:11 user nova-compute[74587]:   <on_poweroff>destroy</on_poweroff>
Oct 18 07:11:11 user nova-compute[74587]:   <on_reboot>restart</on_reboot>
Oct 18 07:11:11 user nova-compute[74587]:   <on_crash>destroy</on_crash>
Oct 18 07:11:11 user nova-compute[74587]:   <devices>
Oct 18 07:11:11 user nova-compute[74587]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 18 07:11:11 user nova-compute[74587]:     <disk type='file' device='disk'>
Oct 18 07:11:11 user nova-compute[74587]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 18 07:11:11 user nova-compute[74587]:       <source file='/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk' index='2'/>
Oct 18 07:11:11 user nova-compute[74587]:       <backingStore type='file' index='3'>
Oct 18 07:11:11 user nova-compute[74587]:         <format type='raw'/>
Oct 18 07:11:11 user nova-compute[74587]:         <source file='/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76'/>
Oct 18 07:11:11 user nova-compute[74587]:         <backingStore/>
Oct 18 07:11:11 user nova-compute[74587]:       </backingStore>
Oct 18 07:11:11 user nova-compute[74587]:       <target dev='vda' bus='virtio'/>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='virtio-disk0'/>
Oct 18 07:11:11 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </disk>
Oct 18 07:11:11 user nova-compute[74587]:     <disk type='file' device='cdrom'>
Oct 18 07:11:11 user nova-compute[74587]:       <driver name='qemu' type='raw' cache='none'/>
Oct 18 07:11:11 user nova-compute[74587]:       <source file='/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk.config' index='1'/>
Oct 18 07:11:11 user nova-compute[74587]:       <backingStore/>
Oct 18 07:11:11 user nova-compute[74587]:       <target dev='hda' bus='ide'/>
Oct 18 07:11:11 user nova-compute[74587]:       <readonly/>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='ide0-0-0'/>
Oct 18 07:11:11 user nova-compute[74587]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </disk>
Oct 18 07:11:11 user nova-compute[74587]:     <controller type='usb' index='0' model='none'>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='usb'/>
Oct 18 07:11:11 user nova-compute[74587]:     </controller>
Oct 18 07:11:11 user nova-compute[74587]:     <controller type='pci' index='0' model='pci-root'>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='pci.0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </controller>
Oct 18 07:11:11 user nova-compute[74587]:     <controller type='ide' index='0'>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='ide'/>
Oct 18 07:11:11 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 18 07:11:11 user nova-compute[74587]:     </controller>
Oct 18 07:11:11 user nova-compute[74587]:     <interface type='ethernet'>
Oct 18 07:11:11 user nova-compute[74587]:       <mac address='fa:16:3e:9c:6f:78'/>
Oct 18 07:11:11 user nova-compute[74587]:       <target dev='tapddbc6964-81'/>
Oct 18 07:11:11 user nova-compute[74587]:       <model type='virtio'/>
Oct 18 07:11:11 user nova-compute[74587]:       <mtu size='1442'/>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='net0'/>
Oct 18 07:11:11 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </interface>
Oct 18 07:11:11 user nova-compute[74587]:     <interface type='ethernet'>
Oct 18 07:11:11 user nova-compute[74587]:       <mac address='fa:16:3e:0e:4e:e8'/>
Oct 18 07:11:11 user nova-compute[74587]:       <target dev='tap7a367dbf-bc'/>
Oct 18 07:11:11 user nova-compute[74587]:       <model type='virtio'/>
Oct 18 07:11:11 user nova-compute[74587]:       <mtu size='1442'/>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='net1'/>
Oct 18 07:11:11 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </interface>
Oct 18 07:11:11 user nova-compute[74587]:     <serial type='pty'>
Oct 18 07:11:11 user nova-compute[74587]:       <source path='/dev/pts/7'/>
Oct 18 07:11:11 user nova-compute[74587]:       <log file='/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/console.log' append='off'/>
Oct 18 07:11:11 user nova-compute[74587]:       <target type='isa-serial' port='0'>
Oct 18 07:11:11 user nova-compute[74587]:         <model name='isa-serial'/>
Oct 18 07:11:11 user nova-compute[74587]:       </target>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='serial0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </serial>
Oct 18 07:11:11 user nova-compute[74587]:     <console type='pty' tty='/dev/pts/7'>
Oct 18 07:11:11 user nova-compute[74587]:       <source path='/dev/pts/7'/>
Oct 18 07:11:11 user nova-compute[74587]:       <log file='/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/console.log' append='off'/>
Oct 18 07:11:11 user nova-compute[74587]:       <target type='serial' port='0'/>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='serial0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </console>
Oct 18 07:11:11 user nova-compute[74587]:     <input type='mouse' bus='ps2'>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='input0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </input>
Oct 18 07:11:11 user nova-compute[74587]:     <input type='keyboard' bus='ps2'>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='input1'/>
Oct 18 07:11:11 user nova-compute[74587]:     </input>
Oct 18 07:11:11 user nova-compute[74587]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 18 07:11:11 user nova-compute[74587]:       <listen type='address' address='0.0.0.0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </graphics>
Oct 18 07:11:11 user nova-compute[74587]:     <audio id='1' type='none'/>
Oct 18 07:11:11 user nova-compute[74587]:     <video>
Oct 18 07:11:11 user nova-compute[74587]:       <model type='virtio' heads='1' primary='yes'/>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='video0'/>
Oct 18 07:11:11 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </video>
Oct 18 07:11:11 user nova-compute[74587]:     <memballoon model='virtio'>
Oct 18 07:11:11 user nova-compute[74587]:       <stats period='10'/>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='balloon0'/>
Oct 18 07:11:11 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </memballoon>
Oct 18 07:11:11 user nova-compute[74587]:     <rng model='virtio'>
Oct 18 07:11:11 user nova-compute[74587]:       <backend model='random'>/dev/urandom</backend>
Oct 18 07:11:11 user nova-compute[74587]:       <alias name='rng0'/>
Oct 18 07:11:11 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 18 07:11:11 user nova-compute[74587]:     </rng>
Oct 18 07:11:11 user nova-compute[74587]:   </devices>
Oct 18 07:11:11 user nova-compute[74587]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 18 07:11:11 user nova-compute[74587]:     <label>libvirt-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</label>
Oct 18 07:11:11 user nova-compute[74587]:     <imagelabel>libvirt-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</imagelabel>
Oct 18 07:11:11 user nova-compute[74587]:   </seclabel>
Oct 18 07:11:11 user nova-compute[74587]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 18 07:11:11 user nova-compute[74587]:     <label>+64055:+108</label>
Oct 18 07:11:11 user nova-compute[74587]:     <imagelabel>+64055:+108</imagelabel>
Oct 18 07:11:11 user nova-compute[74587]:   </seclabel>
Oct 18 07:11:11 user nova-compute[74587]: </domain>
Oct 18 07:11:11 user nova-compute[74587]:  {{(pid=74587) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 18 07:11:11 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Successfully detached device tap7a367dbf-bc from instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c from the persistent domain config.
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] (1/8): Attempting to detach device tap7a367dbf-bc with device alias net1 from instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] detach device xml: <interface type="ethernet">
Oct 18 07:11:11 user nova-compute[74587]:   <mac address="fa:16:3e:0e:4e:e8"/>
Oct 18 07:11:11 user nova-compute[74587]:   <model type="virtio"/>
Oct 18 07:11:11 user nova-compute[74587]:   <mtu size="1442"/>
Oct 18 07:11:11 user nova-compute[74587]:   <target dev="tap7a367dbf-bc"/>
Oct 18 07:11:11 user nova-compute[74587]: </interface>
Oct 18 07:11:11 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.objects.instance [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lazy-loading 'flavor' on Instance uuid dc1910eb-a1c1-4310-ba25-42ac6e4d724b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.168s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Start waiting for the detach event from libvirt for device tap7a367dbf-bc with device alias net1 for instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:11:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:12 user nova-compute[74587]: INFO nova.compute.manager [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Terminating instance
Oct 18 07:11:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 93323264 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:12 user nova-compute[74587]: INFO nova.compute.manager [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Attaching volume 06c33e07-1a17-4c2f-9a1b-d0818eb03627 to /dev/vdb
Oct 18 07:11:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-55aa4f83-c0d0-4993-894e-e0efd20db879 req-1f9d94ff-7d54-4e77-952b-36f1d7ab9e1d service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-unplugged-7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-55aa4f83-c0d0-4993-894e-e0efd20db879 req-1f9d94ff-7d54-4e77-952b-36f1d7ab9e1d service nova] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-55aa4f83-c0d0-4993-894e-e0efd20db879 req-1f9d94ff-7d54-4e77-952b-36f1d7ab9e1d service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-55aa4f83-c0d0-4993-894e-e0efd20db879 req-1f9d94ff-7d54-4e77-952b-36f1d7ab9e1d service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-55aa4f83-c0d0-4993-894e-e0efd20db879 req-1f9d94ff-7d54-4e77-952b-36f1d7ab9e1d service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] No waiting events found dispatching network-vif-unplugged-7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:12 user nova-compute[74587]: WARNING nova.compute.manager [req-55aa4f83-c0d0-4993-894e-e0efd20db879 req-1f9d94ff-7d54-4e77-952b-36f1d7ab9e1d service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received unexpected event network-vif-unplugged-7a367dbf-bcb5-437b-bd09-626f377a43da for instance with vm_state active and task_state None.
Oct 18 07:11:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG os_brick.utils [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d7b6d7-400c-4e3c-b264-295dddc63818]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d0e86b-9777-4094-852f-6dcd8aece570]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lazy-loading 'flavor' on Instance uuid 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbc62b7-cf7f-41bd-9f5b-15a78bff7e25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b852ba-9583-4b00-bec7-3b6f508acf05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:11:12 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6571f375-48cc-4620-a30e-8e0c29287bee]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG os_brick.utils [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] <== get_connector_properties: return (252ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating existing volume attachment record: 07985ff7-0786-4ef3-a328-3707e60412af {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 220200960 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9ac6c6d9-6917-4ce8-b05c-b1fadf0c047e tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.662s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-5bcd1962-76d1-4d25-9857-44e8d9539eef req-010694b4-c244-45de-9c4f-88214783aa13 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received event network-vif-unplugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5bcd1962-76d1-4d25-9857-44e8d9539eef req-010694b4-c244-45de-9c4f-88214783aa13 service nova] Acquiring lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5bcd1962-76d1-4d25-9857-44e8d9539eef req-010694b4-c244-45de-9c4f-88214783aa13 service nova] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5bcd1962-76d1-4d25-9857-44e8d9539eef req-010694b4-c244-45de-9c4f-88214783aa13 service nova] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-5bcd1962-76d1-4d25-9857-44e8d9539eef req-010694b4-c244-45de-9c4f-88214783aa13 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] No waiting events found dispatching network-vif-unplugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-5bcd1962-76d1-4d25-9857-44e8d9539eef req-010694b4-c244-45de-9c4f-88214783aa13 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received event network-vif-unplugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.397s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:13 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Instance destroyed successfully.
Oct 18 07:11:13 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lazy-loading 'resources' on Instance uuid 4ef9e718-1203-413a-909f-b0cf90a5b2b9 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1269783988',display_name='tempest-AttachSCSIVolumeTestJSON-server-1269783988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1269783988',id=5,image_ref='9081d5ac-49c6-4e88-b0b0-2fa83760a211',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk9XGlGFifE3Ub4pid/aptPLLb6u4UD/Rb1FswGlAupYvxUIkMDFgURyp1+d+SEZR/NiVi8MfYJ/3WPkOUWtAhQM6gI3rRkv/xbRYgP/Jx2uGp3CUei1vFTBPtslCU6VQ==',key_name='tempest-keypair-1663419770',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b2099973a6f465e800ba0cf704ebde6',ramdisk_id='',reservation_id='r-508grw0a',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9081d5ac-49c6-4e88-b0b0-2fa83760a211',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-26652777',owner_user_name='tempest-AttachSCSIVolumeTestJSON-26652777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:07:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6f3e19629ad4476979f7fceb2f418b5',uuid=4ef9e718-1203-413a-909f-b0cf90a5b2b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Converting VIF {"id": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "address": "fa:16:3e:02:e7:a8", "network": {"id": "fe6f0bef-dd63-4c68-a83c-d5881437cf08", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-634946411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2099973a6f465e800ba0cf704ebde6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf1510a-3e", "ovs_interfaceid": "3bf1510a-3efc-4d46-b016-ffeacfc7025e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:e7:a8,bridge_name='br-int',has_traffic_filtering=True,id=3bf1510a-3efc-4d46-b016-ffeacfc7025e,network=Network(fe6f0bef-dd63-4c68-a83c-d5881437cf08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf1510a-3e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG os_vif [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:e7:a8,bridge_name='br-int',has_traffic_filtering=True,id=3bf1510a-3efc-4d46-b016-ffeacfc7025e,network=Network(fe6f0bef-dd63-4c68-a83c-d5881437cf08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf1510a-3e') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bf1510a-3e, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 354418688 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9b2b46b-794c-4165-827c-402eb0abccbb) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:13 user nova-compute[74587]: INFO os_vif [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:e7:a8,bridge_name='br-int',has_traffic_filtering=True,id=3bf1510a-3efc-4d46-b016-ffeacfc7025e,network=Network(fe6f0bef-dd63-4c68-a83c-d5881437cf08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf1510a-3e')
Oct 18 07:11:13 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Deleting instance files /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9_del
Oct 18 07:11:13 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Deletion of /opt/stack/data/nova/instances/4ef9e718-1203-413a-909f-b0cf90a5b2b9_del complete
Oct 18 07:11:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:13 user nova-compute[74587]: INFO nova.compute.manager [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 18 07:11:13 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 503316480 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 627048448 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-7daf0f45-a912-4b03-bc49-d29008518cd7 req-e6f97f2d-778d-4222-8444-d1cba43d3c1d service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-plugged-7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7daf0f45-a912-4b03-bc49-d29008518cd7 req-e6f97f2d-778d-4222-8444-d1cba43d3c1d service nova] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7daf0f45-a912-4b03-bc49-d29008518cd7 req-e6f97f2d-778d-4222-8444-d1cba43d3c1d service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7daf0f45-a912-4b03-bc49-d29008518cd7 req-e6f97f2d-778d-4222-8444-d1cba43d3c1d service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-7daf0f45-a912-4b03-bc49-d29008518cd7 req-e6f97f2d-778d-4222-8444-d1cba43d3c1d service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] No waiting events found dispatching network-vif-plugged-7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:14 user nova-compute[74587]: WARNING nova.compute.manager [req-7daf0f45-a912-4b03-bc49-d29008518cd7 req-e6f97f2d-778d-4222-8444-d1cba43d3c1d service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received unexpected event network-vif-plugged-7a367dbf-bcb5-437b-bd09-626f377a43da for instance with vm_state active and task_state None.
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 787480576 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-89d9e970-a5c3-4e0a-8b03-302972c4919a req-d95c83a8-f00d-4f6f-b2f4-3ccfafc2931a service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received event network-vif-plugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89d9e970-a5c3-4e0a-8b03-302972c4919a req-d95c83a8-f00d-4f6f-b2f4-3ccfafc2931a service nova] Acquiring lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89d9e970-a5c3-4e0a-8b03-302972c4919a req-d95c83a8-f00d-4f6f-b2f4-3ccfafc2931a service nova] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89d9e970-a5c3-4e0a-8b03-302972c4919a req-d95c83a8-f00d-4f6f-b2f4-3ccfafc2931a service nova] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-89d9e970-a5c3-4e0a-8b03-302972c4919a req-d95c83a8-f00d-4f6f-b2f4-3ccfafc2931a service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] No waiting events found dispatching network-vif-plugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:14 user nova-compute[74587]: WARNING nova.compute.manager [req-89d9e970-a5c3-4e0a-8b03-302972c4919a req-d95c83a8-f00d-4f6f-b2f4-3ccfafc2931a service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received unexpected event network-vif-plugged-3bf1510a-3efc-4d46-b016-ffeacfc7025e for instance with vm_state active and task_state deleting.
Oct 18 07:11:14 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d is timed out.
Oct 18 07:11:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Successfully detached device vdb from instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d from the live domain config.
Oct 18 07:11:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqfvHMSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:14 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d41514a-c861-4966-861e-66109978a16f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:11:15 user nova-compute[74587]: No targets found.
Oct 18 07:11:15 user nova-compute[74587]: iSNS:
Oct 18 07:11:15 user nova-compute[74587]: No targets found.
Oct 18 07:11:15 user nova-compute[74587]: STATIC:
Oct 18 07:11:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5
Oct 18 07:11:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236
Oct 18 07:11:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016
Oct 18 07:11:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12
Oct 18 07:11:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb
Oct 18 07:11:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:11:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:11:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae
Oct 18 07:11:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:11:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:15 user nova-compute[74587]: FIRMWARE:
Oct 18 07:11:15 user nova-compute[74587]: No targets found.
Oct 18 07:11:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:11:15 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:11:15 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2dd955-eb4a-427b-9d3d-7bd5cee282a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.311s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.132s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5975d7-7965-4dc1-8a66-088a14b884f0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:15 user nova-compute[74587]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 (non-flash)
Oct 18 07:11:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46cfc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016'): ({'sdi'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Removing single pathed devices sdi {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[32745cd7-511a-44ba-bf4d-f58f4a085dab]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 836763648 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29d9a06-4c5e-48e7-8a8c-f5b8c164bbc7]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Flushing IO for device /dev/sdi {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bda88d-04eb-4fee-b892-11a0958b60f1]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.101s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe577dc-4ef9-43c8-be41-80fc3de58355]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] SCSI volumes sdi have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[57503c39-1c14-4ff7-8295-26fdc7e5189b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:15 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Took 2.19 seconds to deallocate network for instance.
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde3f6e8-ede8-4e8a-95df-adc4f4288ca3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016, portal: 172.16.0.220,3260]
Oct 18 07:11:15 user nova-compute[74587]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b269a736-e0bf-45b7-b758-b99dfb408016 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f93d2cc-05a2-4ab3-bd7e-c37ffb3a8eae]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.840s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] <== disconnect_volume: return (842ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:11:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdl (vdc) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-6ddf2555-a576-4c78-87d7-24d33f2464a2 req-4017f1a7-25c0-4a99-8495-361918102076 service nova] [instance: 4ef9e718-1203-413a-909f-b0cf90a5b2b9] Received event network-vif-deleted-3bf1510a-3efc-4d46-b016-ffeacfc7025e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:16 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:11:16 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:11:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7516MB free_disk=25.495662689208984GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDKIUvay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:16 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3c694d-c3f7-4843-9a52-b9896b4dd81f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:11:16 user nova-compute[74587]: No targets found.
Oct 18 07:11:16 user nova-compute[74587]: iSNS:
Oct 18 07:11:16 user nova-compute[74587]: No targets found.
Oct 18 07:11:16 user nova-compute[74587]: STATIC:
Oct 18 07:11:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5
Oct 18 07:11:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236
Oct 18 07:11:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12
Oct 18 07:11:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb
Oct 18 07:11:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:11:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:11:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae
Oct 18 07:11:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:11:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:16 user nova-compute[74587]: FIRMWARE:
Oct 18 07:11:16 user nova-compute[74587]: No targets found.
Oct 18 07:11:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:11:16 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:11:16 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[30468ae4-12a9-4407-98e6-e98eb375ec80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e287144-ed21-46e7-b6f7-bc1a550d075e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:16 user nova-compute[74587]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46adfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb'): ({'sdh'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Removing single pathed devices sdh {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eab8550-c076-4a34-a3e8-c16f696e73fd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[503dba20-8776-44ea-917b-ff9cec810399]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Flushing IO for device /dev/sdh {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faa1c5b-f87a-48e9-87aa-ac8dbd2a4923]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lazy-loading 'flavor' on Instance uuid fe0bd998-4fb1-45fc-a2c3-c3486c54754d {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[58454a6d-a854-4e69-800c-310b139b19e0]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] SCSI volumes sdh have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.158s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b153b6b6-e993-4d04-8a53-e15559e17f1f tempest-VolumesAssistedSnapshotsTest-1572470315 tempest-VolumesAssistedSnapshotsTest-1572470315-project-admin] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.645s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.371s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[360b1c04-564f-41d8-a19a-f69d0221b0d3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:17 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Deleted allocations for instance 4ef9e718-1203-413a-909f-b0cf90a5b2b9
Oct 18 07:11:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[345dbba8-cdeb-4cdb-8368-9c8fdafded1e]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260]
Oct 18 07:11:17 user nova-compute[74587]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec435f5-bee3-4642-bf0c-ff0a802ee497]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] <== disconnect_volume: return (390ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f4cc5b62-8976-48e4-9d04-99d05de3a4f0 tempest-AttachSCSIVolumeTestJSON-26652777 tempest-AttachSCSIVolumeTestJSON-26652777-project-member] Lock "4ef9e718-1203-413a-909f-b0cf90a5b2b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.980s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 205d8114-61a9-4108-9f65-042656ad2a69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance c17be69f-69e9-455c-9f83-5b2851b1d646 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance fe149618-b362-4460-84d3-1b8e0e56f2f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znsvVUtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '205d8114-61a9-4108-9f65-042656ad2a69', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 'serial'} {{(pid=74587) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] swap_volume: removing Cinder connection for volume a9375339-bbe2-47a4-9083-9ec645a09ecb {{(pid=74587) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:11:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] swap_volume: Updating volume a9375339-bbe2-47a4-9083-9ec645a09ecb BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "znsvVUtZ", "auth_password": "74pY1lV3DTfSvz", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5"}, "status": "reserved", "instance": "205d8114-61a9-4108-9f65-042656ad2a69", "attached_at": "", "detached_at": "", "volume_id": "b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5", "serial": "b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 'no_device': None, 'attachment_id': '3e495151-4ea0-4eb7-acb1-ff1d1876d111'} {{(pid=74587) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f0ead57-594a-475a-aa60-5a1ed71b9584 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "205d8114-61a9-4108-9f65-042656ad2a69" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 30.362s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "205d8114-61a9-4108-9f65-042656ad2a69" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG os_brick.utils [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[212689ae-06e4-4e77-b0d8-1da56501261e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[37228ef4-c0b2-419b-ab9e-5189fb736396]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d28b4be-be60-42a7-9961-984a6279f37c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef22a99-a2e9-42a8-abfb-e8c525c0bb21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:11:18 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:11:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabb554c-9b37-4e7f-a106-71e39ff21d0b]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:11:18 user nova-compute[74587]: DEBUG os_brick.utils [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:19 user nova-compute[74587]: INFO nova.compute.manager [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Swapping volume b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 for a9375339-bbe2-47a4-9083-9ec645a09ecb
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:11:21 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Creating image(s)
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Ensure instance console log exists: /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Start _get_guest_xml network_info=[{"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3cf09563-ec28-4024-a997-c00a980ae394', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVTGlAzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd9651223-0963-4247-ab2b-48f42efb1dc8', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba176de3-087f-4f43-bd58-b8194b58f3ef', 'serial': 'ba176de3-087f-4f43-bd58-b8194b58f3ef'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:11:21 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:11:21 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVTGlAzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:21 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:21 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:21 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba76dc8-8c01-4c1f-8e80-55c05f24f51a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:11:21 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[929a0396-2e2e-4f97-9a29-4d752f4b4d51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef] added
Oct 18 07:11:21 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a010a0ea-f121-4c99-9587-228c1c6a15d9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[731e872f-de19-4d8b-99a9-dba9dfef3d76]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVTGlAzb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVTGlAzb" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edb4321-ea96-4ce9-8c04-c568830e4bd4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EVTGlAzb'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cabd0c4-2b8d-450e-aafd-6c3c94a92df0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff9e4af-2941-48dd-955e-52effc866f9b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f9f544-d300-4bc4-ac19-fd5b6f3a63d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef, portal: 172.16.0.220,3260]
Oct 18 07:11:22 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:22 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fb90fc-f420-49c9-a243-1c36f8c73962]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb2d058-8827-4b96-b35c-eee382f2d05e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:22 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:22 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdb69af-37ba-4c26-b2f7-e4576b56ec7f]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:11:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVTGlAzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23436326333383930', 'path': '/dev/sdc'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436326333383930', 'path': '/dev/sdc'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1798708892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1798708892',id=12,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-604sfei6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:10:11Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=d9651223-0963-4247-ab2b-48f42efb1dc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=6776f41a-346e-45fa-a618-bc4f28583854,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6776f41a-34') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'pci_devices' on Instance uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:11:23 user nova-compute[74587]:   <uuid>d9651223-0963-4247-ab2b-48f42efb1dc8</uuid>
Oct 18 07:11:23 user nova-compute[74587]:   <name>instance-0000000c</name>
Oct 18 07:11:23 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:11:23 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:11:23 user nova-compute[74587]:   <metadata>
Oct 18 07:11:23 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:11:23 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:11:23 user nova-compute[74587]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1798708892</nova:name>
Oct 18 07:11:23 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:11:21</nova:creationTime>
Oct 18 07:11:23 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:11:23 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:11:23 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:11:23 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:11:23 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:11:23 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:11:23 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:11:23 user nova-compute[74587]:       <nova:owner>
Oct 18 07:11:23 user nova-compute[74587]:         <nova:user uuid="e2ca09ce37384d25931eb9a658384255">tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member</nova:user>
Oct 18 07:11:23 user nova-compute[74587]:         <nova:project uuid="c002a125aec54fa388965a9f83cc1624">tempest-ServerBootFromVolumeStableRescueTest-1990729548</nova:project>
Oct 18 07:11:23 user nova-compute[74587]:       </nova:owner>
Oct 18 07:11:23 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:11:23 user nova-compute[74587]:       <nova:ports>
Oct 18 07:11:23 user nova-compute[74587]:         <nova:port uuid="6776f41a-346e-45fa-a618-bc4f28583854">
Oct 18 07:11:23 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 18 07:11:23 user nova-compute[74587]:         </nova:port>
Oct 18 07:11:23 user nova-compute[74587]:       </nova:ports>
Oct 18 07:11:23 user nova-compute[74587]:     </nova:instance>
Oct 18 07:11:23 user nova-compute[74587]:   </metadata>
Oct 18 07:11:23 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:11:23 user nova-compute[74587]:     <system>
Oct 18 07:11:23 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:11:23 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:11:23 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:11:23 user nova-compute[74587]:       <entry name="serial">d9651223-0963-4247-ab2b-48f42efb1dc8</entry>
Oct 18 07:11:23 user nova-compute[74587]:       <entry name="uuid">d9651223-0963-4247-ab2b-48f42efb1dc8</entry>
Oct 18 07:11:23 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:11:23 user nova-compute[74587]:     </system>
Oct 18 07:11:23 user nova-compute[74587]:   </sysinfo>
Oct 18 07:11:23 user nova-compute[74587]:   <os>
Oct 18 07:11:23 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:11:23 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:11:23 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:11:23 user nova-compute[74587]:   </os>
Oct 18 07:11:23 user nova-compute[74587]:   <features>
Oct 18 07:11:23 user nova-compute[74587]:     <acpi/>
Oct 18 07:11:23 user nova-compute[74587]:     <apic/>
Oct 18 07:11:23 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:11:23 user nova-compute[74587]:   </features>
Oct 18 07:11:23 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:11:23 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:11:23 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:11:23 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:11:23 user nova-compute[74587]:   </clock>
Oct 18 07:11:23 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:11:23 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:11:23 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:11:23 user nova-compute[74587]:   </cpu>
Oct 18 07:11:23 user nova-compute[74587]:   <devices>
Oct 18 07:11:23 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:11:23 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:11:23 user nova-compute[74587]:       <source dev="/dev/sdc"/>
Oct 18 07:11:23 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:11:23 user nova-compute[74587]:       <serial>ba176de3-087f-4f43-bd58-b8194b58f3ef</serial>
Oct 18 07:11:23 user nova-compute[74587]:     </disk>
Oct 18 07:11:23 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:11:23 user nova-compute[74587]:       <mac address="fa:16:3e:7f:e2:2a"/>
Oct 18 07:11:23 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:11:23 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:11:23 user nova-compute[74587]:       <target dev="tap6776f41a-34"/>
Oct 18 07:11:23 user nova-compute[74587]:     </interface>
Oct 18 07:11:23 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:11:23 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/console.log" append="off"/>
Oct 18 07:11:23 user nova-compute[74587]:     </serial>
Oct 18 07:11:23 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:11:23 user nova-compute[74587]:     <video>
Oct 18 07:11:23 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:11:23 user nova-compute[74587]:     </video>
Oct 18 07:11:23 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:11:23 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:11:23 user nova-compute[74587]:     </rng>
Oct 18 07:11:23 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:11:23 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:11:23 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:11:23 user nova-compute[74587]:     </memballoon>
Oct 18 07:11:23 user nova-compute[74587]:   </devices>
Oct 18 07:11:23 user nova-compute[74587]: </domain>
Oct 18 07:11:23 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1798708892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1798708892',id=12,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-604sfei6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:10:11Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=d9651223-0963-4247-ab2b-48f42efb1dc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=6776f41a-346e-45fa-a618-bc4f28583854,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6776f41a-34') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG os_vif [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=6776f41a-346e-45fa-a618-bc4f28583854,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6776f41a-34') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65bde91a-3f6f-559c-a35d-6aea7f0b8d85', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6776f41a-34, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6776f41a-34, col_values=(('qos', UUID('04334aba-d785-43ce-9461-91e23a332fd9')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6776f41a-34, col_values=(('external_ids', {'iface-id': '6776f41a-346e-45fa-a618-bc4f28583854', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:e2:2a', 'vm-uuid': 'd9651223-0963-4247-ab2b-48f42efb1dc8'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:23 user nova-compute[74587]: INFO os_vif [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=6776f41a-346e-45fa-a618-bc4f28583854,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6776f41a-34')
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:11:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No VIF found with MAC fa:16:3e:7f:e2:2a, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:11:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-22fd0720-d309-4e4b-9dc7-ff027f939f0c req-ab9b3852-341c-41bc-9b96-413f73f18352 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22fd0720-d309-4e4b-9dc7-ff027f939f0c req-ab9b3852-341c-41bc-9b96-413f73f18352 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22fd0720-d309-4e4b-9dc7-ff027f939f0c req-ab9b3852-341c-41bc-9b96-413f73f18352 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22fd0720-d309-4e4b-9dc7-ff027f939f0c req-ab9b3852-341c-41bc-9b96-413f73f18352 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-22fd0720-d309-4e4b-9dc7-ff027f939f0c req-ab9b3852-341c-41bc-9b96-413f73f18352 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:25 user nova-compute[74587]: WARNING nova.compute.manager [req-22fd0720-d309-4e4b-9dc7-ff027f939f0c req-ab9b3852-341c-41bc-9b96-413f73f18352 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state building and task_state spawning.
Oct 18 07:11:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:11:27 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Instance spawned successfully.
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:27 user nova-compute[74587]: INFO nova.compute.manager [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Took 5.32 seconds to spawn the instance on the hypervisor.
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-5fefceee-5cb5-449e-a7e5-111cb10a4e5a req-b7bd6fd5-8789-4ad1-bc27-93a18c75dd41 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5fefceee-5cb5-449e-a7e5-111cb10a4e5a req-b7bd6fd5-8789-4ad1-bc27-93a18c75dd41 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5fefceee-5cb5-449e-a7e5-111cb10a4e5a req-b7bd6fd5-8789-4ad1-bc27-93a18c75dd41 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5fefceee-5cb5-449e-a7e5-111cb10a4e5a req-b7bd6fd5-8789-4ad1-bc27-93a18c75dd41 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-5fefceee-5cb5-449e-a7e5-111cb10a4e5a req-b7bd6fd5-8789-4ad1-bc27-93a18c75dd41 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:27 user nova-compute[74587]: WARNING nova.compute.manager [req-5fefceee-5cb5-449e-a7e5-111cb10a4e5a req-b7bd6fd5-8789-4ad1-bc27-93a18c75dd41 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state building and task_state spawning.
Oct 18 07:11:27 user nova-compute[74587]: INFO nova.compute.manager [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Took 77.49 seconds to build instance.
Oct 18 07:11:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b7a801d4-627a-4c1f-ac2d-7fac995b32c9 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 77.588s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-fc71970c-a3ef-4539-acc3-0407bb34a8b7 req-1d1e1609-726c-43f2-b0e4-1075091d0844 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-changed-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-fc71970c-a3ef-4539-acc3-0407bb34a8b7 req-1d1e1609-726c-43f2-b0e4-1075091d0844 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing instance network info cache due to event network-changed-73afc3a4-da0c-42ea-b866-75dc761137d8. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fc71970c-a3ef-4539-acc3-0407bb34a8b7 req-1d1e1609-726c-43f2-b0e4-1075091d0844 service nova] Acquiring lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fc71970c-a3ef-4539-acc3-0407bb34a8b7 req-1d1e1609-726c-43f2-b0e4-1075091d0844 service nova] Acquired lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG nova.network.neutron [req-fc71970c-a3ef-4539-acc3-0407bb34a8b7 req-1d1e1609-726c-43f2-b0e4-1075091d0844 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Refreshing network info cache for port 73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:11:31 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Waiting for libvirt event about the detach of device tap7a367dbf-bc with device alias net1 from instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c is timed out.
Oct 18 07:11:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:4e:e8"/><model type="virtio"/><mtu size="1442"/><target dev="tap7a367dbf-bc"/></interface> {{(pid=74587) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:4e:e8"/><model type="virtio"/><mtu size="1442"/><target dev="tap7a367dbf-bc"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 18 07:11:31 user nova-compute[74587]:   <name>instance-00000007</name>
Oct 18 07:11:31 user nova-compute[74587]:   <uuid>2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</uuid>
Oct 18 07:11:31 user nova-compute[74587]:   <metadata>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:11:31 user nova-compute[74587]:   <nova:package version="0.0.0"/>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:name>tempest-device-tagging-server-675565366</nova:name>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:creationTime>2023-10-18 07:09:40</nova:creationTime>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:flavor name="m1.tiny">
Oct 18 07:11:31 user nova-compute[74587]:     <nova:memory>512</nova:memory>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:disk>1</nova:disk>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:swap>0</nova:swap>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:vcpus>1</nova:vcpus>
Oct 18 07:11:31 user nova-compute[74587]:   </nova:flavor>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:owner>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:user uuid="42bc78aefa2847238a3b25da59c9a148">tempest-TaggedAttachmentsTest-259044806-project-member</nova:user>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:project uuid="884f75b337bf4ab5b239e3e1e16954ed">tempest-TaggedAttachmentsTest-259044806</nova:project>
Oct 18 07:11:31 user nova-compute[74587]:   </nova:owner>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:ports>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:port uuid="ddbc6964-8191-4483-8a63-2c853584be6f">
Oct 18 07:11:31 user nova-compute[74587]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 07:11:31 user nova-compute[74587]:     </nova:port>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:port uuid="7a367dbf-bcb5-437b-bd09-626f377a43da">
Oct 18 07:11:31 user nova-compute[74587]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Oct 18 07:11:31 user nova-compute[74587]:     </nova:port>
Oct 18 07:11:31 user nova-compute[74587]:   </nova:ports>
Oct 18 07:11:31 user nova-compute[74587]: </nova:instance>
Oct 18 07:11:31 user nova-compute[74587]:   </metadata>
Oct 18 07:11:31 user nova-compute[74587]:   <memory unit='KiB'>524288</memory>
Oct 18 07:11:31 user nova-compute[74587]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 18 07:11:31 user nova-compute[74587]:   <vcpu placement='static'>1</vcpu>
Oct 18 07:11:31 user nova-compute[74587]:   <resource>
Oct 18 07:11:31 user nova-compute[74587]:     <partition>/machine</partition>
Oct 18 07:11:31 user nova-compute[74587]:   </resource>
Oct 18 07:11:31 user nova-compute[74587]:   <sysinfo type='smbios'>
Oct 18 07:11:31 user nova-compute[74587]:     <system>
Oct 18 07:11:31 user nova-compute[74587]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 18 07:11:31 user nova-compute[74587]:       <entry name='product'>OpenStack Nova</entry>
Oct 18 07:11:31 user nova-compute[74587]:       <entry name='version'>0.0.0</entry>
Oct 18 07:11:31 user nova-compute[74587]:       <entry name='serial'>2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</entry>
Oct 18 07:11:31 user nova-compute[74587]:       <entry name='uuid'>2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</entry>
Oct 18 07:11:31 user nova-compute[74587]:       <entry name='family'>Virtual Machine</entry>
Oct 18 07:11:31 user nova-compute[74587]:     </system>
Oct 18 07:11:31 user nova-compute[74587]:   </sysinfo>
Oct 18 07:11:31 user nova-compute[74587]:   <os>
Oct 18 07:11:31 user nova-compute[74587]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 18 07:11:31 user nova-compute[74587]:     <boot dev='hd'/>
Oct 18 07:11:31 user nova-compute[74587]:     <smbios mode='sysinfo'/>
Oct 18 07:11:31 user nova-compute[74587]:   </os>
Oct 18 07:11:31 user nova-compute[74587]:   <features>
Oct 18 07:11:31 user nova-compute[74587]:     <acpi/>
Oct 18 07:11:31 user nova-compute[74587]:     <apic/>
Oct 18 07:11:31 user nova-compute[74587]:     <vmcoreinfo state='on'/>
Oct 18 07:11:31 user nova-compute[74587]:   </features>
Oct 18 07:11:31 user nova-compute[74587]:   <cpu mode='custom' match='exact' check='full'>
Oct 18 07:11:31 user nova-compute[74587]:     <model fallback='forbid'>Nehalem</model>
Oct 18 07:11:31 user nova-compute[74587]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 18 07:11:31 user nova-compute[74587]:     <feature policy='require' name='vme'/>
Oct 18 07:11:31 user nova-compute[74587]:     <feature policy='require' name='x2apic'/>
Oct 18 07:11:31 user nova-compute[74587]:     <feature policy='require' name='hypervisor'/>
Oct 18 07:11:31 user nova-compute[74587]:   </cpu>
Oct 18 07:11:31 user nova-compute[74587]:   <clock offset='utc'>
Oct 18 07:11:31 user nova-compute[74587]:     <timer name='pit' tickpolicy='delay'/>
Oct 18 07:11:31 user nova-compute[74587]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 18 07:11:31 user nova-compute[74587]:     <timer name='hpet' present='no'/>
Oct 18 07:11:31 user nova-compute[74587]:   </clock>
Oct 18 07:11:31 user nova-compute[74587]:   <on_poweroff>destroy</on_poweroff>
Oct 18 07:11:31 user nova-compute[74587]:   <on_reboot>restart</on_reboot>
Oct 18 07:11:31 user nova-compute[74587]:   <on_crash>destroy</on_crash>
Oct 18 07:11:31 user nova-compute[74587]:   <devices>
Oct 18 07:11:31 user nova-compute[74587]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 18 07:11:31 user nova-compute[74587]:     <disk type='file' device='disk'>
Oct 18 07:11:31 user nova-compute[74587]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 18 07:11:31 user nova-compute[74587]:       <source file='/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk' index='2'/>
Oct 18 07:11:31 user nova-compute[74587]:       <backingStore type='file' index='3'>
Oct 18 07:11:31 user nova-compute[74587]:         <format type='raw'/>
Oct 18 07:11:31 user nova-compute[74587]:         <source file='/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76'/>
Oct 18 07:11:31 user nova-compute[74587]:         <backingStore/>
Oct 18 07:11:31 user nova-compute[74587]:       </backingStore>
Oct 18 07:11:31 user nova-compute[74587]:       <target dev='vda' bus='virtio'/>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='virtio-disk0'/>
Oct 18 07:11:31 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </disk>
Oct 18 07:11:31 user nova-compute[74587]:     <disk type='file' device='cdrom'>
Oct 18 07:11:31 user nova-compute[74587]:       <driver name='qemu' type='raw' cache='none'/>
Oct 18 07:11:31 user nova-compute[74587]:       <source file='/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/disk.config' index='1'/>
Oct 18 07:11:31 user nova-compute[74587]:       <backingStore/>
Oct 18 07:11:31 user nova-compute[74587]:       <target dev='hda' bus='ide'/>
Oct 18 07:11:31 user nova-compute[74587]:       <readonly/>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='ide0-0-0'/>
Oct 18 07:11:31 user nova-compute[74587]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </disk>
Oct 18 07:11:31 user nova-compute[74587]:     <controller type='usb' index='0' model='none'>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='usb'/>
Oct 18 07:11:31 user nova-compute[74587]:     </controller>
Oct 18 07:11:31 user nova-compute[74587]:     <controller type='pci' index='0' model='pci-root'>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='pci.0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </controller>
Oct 18 07:11:31 user nova-compute[74587]:     <controller type='ide' index='0'>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='ide'/>
Oct 18 07:11:31 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 18 07:11:31 user nova-compute[74587]:     </controller>
Oct 18 07:11:31 user nova-compute[74587]:     <interface type='ethernet'>
Oct 18 07:11:31 user nova-compute[74587]:       <mac address='fa:16:3e:9c:6f:78'/>
Oct 18 07:11:31 user nova-compute[74587]:       <target dev='tapddbc6964-81'/>
Oct 18 07:11:31 user nova-compute[74587]:       <model type='virtio'/>
Oct 18 07:11:31 user nova-compute[74587]:       <mtu size='1442'/>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='net0'/>
Oct 18 07:11:31 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </interface>
Oct 18 07:11:31 user nova-compute[74587]:     <serial type='pty'>
Oct 18 07:11:31 user nova-compute[74587]:       <source path='/dev/pts/7'/>
Oct 18 07:11:31 user nova-compute[74587]:       <log file='/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/console.log' append='off'/>
Oct 18 07:11:31 user nova-compute[74587]:       <target type='isa-serial' port='0'>
Oct 18 07:11:31 user nova-compute[74587]:         <model name='isa-serial'/>
Oct 18 07:11:31 user nova-compute[74587]:       </target>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='serial0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </serial>
Oct 18 07:11:31 user nova-compute[74587]:     <console type='pty' tty='/dev/pts/7'>
Oct 18 07:11:31 user nova-compute[74587]:       <source path='/dev/pts/7'/>
Oct 18 07:11:31 user nova-compute[74587]:       <log file='/opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c/console.log' append='off'/>
Oct 18 07:11:31 user nova-compute[74587]:       <target type='serial' port='0'/>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='serial0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </console>
Oct 18 07:11:31 user nova-compute[74587]:     <input type='mouse' bus='ps2'>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='input0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </input>
Oct 18 07:11:31 user nova-compute[74587]:     <input type='keyboard' bus='ps2'>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='input1'/>
Oct 18 07:11:31 user nova-compute[74587]:     </input>
Oct 18 07:11:31 user nova-compute[74587]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 18 07:11:31 user nova-compute[74587]:       <listen type='address' address='0.0.0.0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </graphics>
Oct 18 07:11:31 user nova-compute[74587]:     <audio id='1' type='none'/>
Oct 18 07:11:31 user nova-compute[74587]:     <video>
Oct 18 07:11:31 user nova-compute[74587]:       <model type='virtio' heads='1' primary='yes'/>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='video0'/>
Oct 18 07:11:31 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </video>
Oct 18 07:11:31 user nova-compute[74587]:     <memballoon model='virtio'>
Oct 18 07:11:31 user nova-compute[74587]:       <stats period='10'/>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='balloon0'/>
Oct 18 07:11:31 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </memballoon>
Oct 18 07:11:31 user nova-compute[74587]:     <rng model='virtio'>
Oct 18 07:11:31 user nova-compute[74587]:       <backend model='random'>/dev/urandom</backend>
Oct 18 07:11:31 user nova-compute[74587]:       <alias name='rng0'/>
Oct 18 07:11:31 user nova-compute[74587]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 18 07:11:31 user nova-compute[74587]:     </rng>
Oct 18 07:11:31 user nova-compute[74587]:   </devices>
Oct 18 07:11:31 user nova-compute[74587]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 18 07:11:31 user nova-compute[74587]:     <label>libvirt-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</label>
Oct 18 07:11:31 user nova-compute[74587]:     <imagelabel>libvirt-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c</imagelabel>
Oct 18 07:11:31 user nova-compute[74587]:   </seclabel>
Oct 18 07:11:31 user nova-compute[74587]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 18 07:11:31 user nova-compute[74587]:     <label>+64055:+108</label>
Oct 18 07:11:31 user nova-compute[74587]:     <imagelabel>+64055:+108</imagelabel>
Oct 18 07:11:31 user nova-compute[74587]:   </seclabel>
Oct 18 07:11:31 user nova-compute[74587]: </domain>
Oct 18 07:11:31 user nova-compute[74587]:  {{(pid=74587) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 18 07:11:31 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Successfully detached device tap7a367dbf-bc from instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c from the live domain config.
Oct 18 07:11:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-675565366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-675565366',id=7,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEO5dx++IX4ljOuW+qNj5hpC2x51PQ/SXgUWZY1ekvFYqfyCilmR4DC2lOZdcQco8cKcpkEKyVcg6SoQUuKw0WDM3TFiS+hwHnBjz0Ph4sNwOOd+murzzpvCJKAO0syDw==',key_name='tempest-keypair-1735451947',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='884f75b337bf4ab5b239e3e1e16954ed',ramdisk_id='',reservation_id='r-6o10505b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-259044806',owner_user_name='tempest-TaggedAttachmentsTest-259044806-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42bc78aefa2847238a3b25da59c9a148',uuid=2c672325-def3-49a9-a7b2-9dfb4fa0ce2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a367dbf-bcb5-437b-bd09-626f377a43da", "address": "fa:16:3e:0e:4e:e8", "network": {"id": "8442b85a-b072-41ed-86fd-ec9e6b3f2f4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-873154978", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a367dbf-bc", "ovs_interfaceid": "7a367dbf-bcb5-437b-bd09-626f377a43da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converting VIF {"id": "7a367dbf-bcb5-437b-bd09-626f377a43da", "address": "fa:16:3e:0e:4e:e8", "network": {"id": "8442b85a-b072-41ed-86fd-ec9e6b3f2f4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-873154978", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a367dbf-bc", "ovs_interfaceid": "7a367dbf-bcb5-437b-bd09-626f377a43da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4e:e8,bridge_name='br-int',has_traffic_filtering=True,id=7a367dbf-bcb5-437b-bd09-626f377a43da,network=Network(8442b85a-b072-41ed-86fd-ec9e6b3f2f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a367dbf-bc') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG os_vif [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4e:e8,bridge_name='br-int',has_traffic_filtering=True,id=7a367dbf-bcb5-437b-bd09-626f377a43da,network=Network(8442b85a-b072-41ed-86fd-ec9e6b3f2f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a367dbf-bc') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a367dbf-bc, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3781e6be-a38b-4846-b0e0-b047e974de08) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:31 user nova-compute[74587]: INFO os_vif [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4e:e8,bridge_name='br-int',has_traffic_filtering=True,id=7a367dbf-bcb5-437b-bd09-626f377a43da,network=Network(8442b85a-b072-41ed-86fd-ec9e6b3f2f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a367dbf-bc')
Oct 18 07:11:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:11:31 user nova-compute[74587]:   <nova:package version="0.0.0"/>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:name>tempest-device-tagging-server-675565366</nova:name>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:creationTime>2023-10-18 07:11:31</nova:creationTime>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:flavor name="m1.tiny">
Oct 18 07:11:31 user nova-compute[74587]:     <nova:memory>512</nova:memory>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:disk>1</nova:disk>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:swap>0</nova:swap>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:vcpus>1</nova:vcpus>
Oct 18 07:11:31 user nova-compute[74587]:   </nova:flavor>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:owner>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:user uuid="42bc78aefa2847238a3b25da59c9a148">tempest-TaggedAttachmentsTest-259044806-project-member</nova:user>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:project uuid="884f75b337bf4ab5b239e3e1e16954ed">tempest-TaggedAttachmentsTest-259044806</nova:project>
Oct 18 07:11:31 user nova-compute[74587]:   </nova:owner>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:11:31 user nova-compute[74587]:   <nova:ports>
Oct 18 07:11:31 user nova-compute[74587]:     <nova:port uuid="ddbc6964-8191-4483-8a63-2c853584be6f">
Oct 18 07:11:31 user nova-compute[74587]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 07:11:31 user nova-compute[74587]:     </nova:port>
Oct 18 07:11:31 user nova-compute[74587]:   </nova:ports>
Oct 18 07:11:31 user nova-compute[74587]: </nova:instance>
Oct 18 07:11:31 user nova-compute[74587]:  {{(pid=74587) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 18 07:11:32 user nova-compute[74587]: DEBUG nova.network.neutron [req-fc71970c-a3ef-4539-acc3-0407bb34a8b7 req-1d1e1609-726c-43f2-b0e4-1075091d0844 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updated VIF entry in instance network info cache for port 73afc3a4-da0c-42ea-b866-75dc761137d8. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:11:32 user nova-compute[74587]: DEBUG nova.network.neutron [req-fc71970c-a3ef-4539-acc3-0407bb34a8b7 req-1d1e1609-726c-43f2-b0e4-1075091d0844 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [{"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fc71970c-a3ef-4539-acc3-0407bb34a8b7 req-1d1e1609-726c-43f2-b0e4-1075091d0844 service nova] Releasing lock "refresh_cache-fe149618-b362-4460-84d3-1b8e0e56f2f7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:11:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:11:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquired lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:11:32 user nova-compute[74587]: DEBUG nova.network.neutron [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:11:33 user nova-compute[74587]: INFO nova.network.neutron [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Port 7a367dbf-bcb5-437b-bd09-626f377a43da from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 18 07:11:33 user nova-compute[74587]: DEBUG nova.network.neutron [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updating instance_info_cache with network_info: [{"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Releasing lock "refresh_cache-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:11:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4bb061e7-84b5-4a4d-9a66-ddf79a9cb636 tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "interface-2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-7a367dbf-bcb5-437b-bd09-626f377a43da" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.805s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-82354fb0-89d2-48cc-a5ac-d97d65018243 req-177d0116-a6e6-40c0-b260-4604aa1c1d8e service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-deleted-7a367dbf-bcb5-437b-bd09-626f377a43da {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:34 user nova-compute[74587]: INFO nova.compute.manager [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Terminating instance
Oct 18 07:11:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:34 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:34 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:34 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:11:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-d215c38c-4903-4baa-ac6c-d6de8006a944 req-4b8ef53d-491b-4891-adfb-2e6e23eb9e74 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d215c38c-4903-4baa-ac6c-d6de8006a944 req-4b8ef53d-491b-4891-adfb-2e6e23eb9e74 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d215c38c-4903-4baa-ac6c-d6de8006a944 req-4b8ef53d-491b-4891-adfb-2e6e23eb9e74 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d215c38c-4903-4baa-ac6c-d6de8006a944 req-4b8ef53d-491b-4891-adfb-2e6e23eb9e74 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-d215c38c-4903-4baa-ac6c-d6de8006a944 req-4b8ef53d-491b-4891-adfb-2e6e23eb9e74 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-unplugged-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-d215c38c-4903-4baa-ac6c-d6de8006a944 req-4b8ef53d-491b-4891-adfb-2e6e23eb9e74 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-73afc3a4-da0c-42ea-b866-75dc761137d8 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[00170d12-b0b1-47a2-81f9-0780863f089f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:11:34 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa3f2e6-66ff-4675-a695-daa2822798d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627] added
Oct 18 07:11:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e9835c-dd55-4940-a555-374ebdcd62b2]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d0a7e-3ca8-400e-a978-f4f0ce3a1907]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycHXUMWF {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycHXUMWF" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[55377500-a30a-4767-9e83-5ca2617b13b2]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycHXUMWF'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59a73c6-a97d-4f9c-908f-4daa06a38f03]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03955b8-04d9-4a88-abb2-e4c1db785011]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-bfacab6c-e226-4a43-8cba-6bcc8fbc1864 req-e6b52ac9-cc54-4df6-bbf8-8e30bfc064d2 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bfacab6c-e226-4a43-8cba-6bcc8fbc1864 req-e6b52ac9-cc54-4df6-bbf8-8e30bfc064d2 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bfacab6c-e226-4a43-8cba-6bcc8fbc1864 req-e6b52ac9-cc54-4df6-bbf8-8e30bfc064d2 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bfacab6c-e226-4a43-8cba-6bcc8fbc1864 req-e6b52ac9-cc54-4df6-bbf8-8e30bfc064d2 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-bfacab6c-e226-4a43-8cba-6bcc8fbc1864 req-e6b52ac9-cc54-4df6-bbf8-8e30bfc064d2 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-unplugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-bfacab6c-e226-4a43-8cba-6bcc8fbc1864 req-e6b52ac9-cc54-4df6-bbf8-8e30bfc064d2 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1500f001-89f9-4edd-9e7d-ef8d23731866]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]
Oct 18 07:11:34 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8384d4ef-5d70-4bde-b9a6-e8f68bccae0f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fe8481-2ef1-436c-ad4f-772c86a94671]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:34 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] HCTL ('38', '-', '-', 0) found on session 15 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[45062e46-6d70-4540-95a4-321f5b1a8401]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:34 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Searching for a device in session 15 and hctl ['38', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-unplugged-afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-afff56e2-e738-461d-8d5b-92152ceb057b for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:35 user nova-compute[74587]: WARNING nova.compute.manager [req-3850554b-031c-47a5-9258-00790762fddb req-0b0790b3-79c6-4856-87ec-86a76518e8d9 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-afff56e2-e738-461d-8d5b-92152ceb057b for instance with vm_state active and task_state deleting.
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Searching for a device in session 15 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '23661366165336330', 'path': '/dev/sdg'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661366165336330', 'path': '/dev/sdg'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.objects.instance [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lazy-loading 'flavor' on Instance uuid dc1910eb-a1c1-4310-ba25-42ac6e4d724b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:36 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Instance destroyed successfully.
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lazy-loading 'resources' on Instance uuid fe149618-b362-4460-84d3-1b8e0e56f2f7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:11:36 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:11:36 user nova-compute[74587]:   <source dev="/dev/sdg"/>
Oct 18 07:11:36 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:11:36 user nova-compute[74587]:   <serial>06c33e07-1a17-4c2f-9a1b-d0818eb03627</serial>
Oct 18 07:11:36 user nova-compute[74587]: </disk>
Oct 18 07:11:36 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "73afc3a4-da0c-42ea-b866-75dc761137d8", "address": "fa:16:3e:72:f2:bb", "network": {"id": "358d948a-aab7-4619-824f-15b39f8388eb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1286856394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73afc3a4-da", "ovs_interfaceid": "73afc3a4-da0c-42ea-b866-75dc761137d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:f2:bb,bridge_name='br-int',has_traffic_filtering=True,id=73afc3a4-da0c-42ea-b866-75dc761137d8,network=Network(358d948a-aab7-4619-824f-15b39f8388eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73afc3a4-da') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:f2:bb,bridge_name='br-int',has_traffic_filtering=True,id=73afc3a4-da0c-42ea-b866-75dc761137d8,network=Network(358d948a-aab7-4619-824f-15b39f8388eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73afc3a4-da') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73afc3a4-da, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fadee89-ccae-419b-8f23-ac143be8ed4a) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: INFO os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:f2:bb,bridge_name='br-int',has_traffic_filtering=True,id=73afc3a4-da0c-42ea-b866-75dc761137d8,network=Network(358d948a-aab7-4619-824f-15b39f8388eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73afc3a4-da')
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6c:5e,bridge_name='br-int',has_traffic_filtering=True,id=534bce4c-d08f-4662-978c-432d52603ecf,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap534bce4c-d0') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6c:5e,bridge_name='br-int',has_traffic_filtering=True,id=534bce4c-d08f-4662-978c-432d52603ecf,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap534bce4c-d0') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap534bce4c-d0, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8201575e-19b8-445f-ba90-5363bd3c4ed2) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: INFO os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:6c:5e,bridge_name='br-int',has_traffic_filtering=True,id=534bce4c-d08f-4662-978c-432d52603ecf,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap534bce4c-d0')
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:45,bridge_name='br-int',has_traffic_filtering=True,id=33ce7796-efa3-4c97-8009-0b2ffb3d18a5,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33ce7796-ef') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:45,bridge_name='br-int',has_traffic_filtering=True,id=33ce7796-efa3-4c97-8009-0b2ffb3d18a5,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33ce7796-ef') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33ce7796-ef, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ecd0cd8-decf-4f39-afd5-59c731635592) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] No VIF found with MAC fa:16:3e:1a:0b:de, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: INFO os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:51:45,bridge_name='br-int',has_traffic_filtering=True,id=33ce7796-efa3-4c97-8009-0b2ffb3d18a5,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33ce7796-ef')
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:78:f0,bridge_name='br-int',has_traffic_filtering=True,id=afff56e2-e738-461d-8d5b-92152ceb057b,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafff56e2-e7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:78:f0,bridge_name='br-int',has_traffic_filtering=True,id=afff56e2-e738-461d-8d5b-92152ceb057b,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafff56e2-e7') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafff56e2-e7, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4da939d-dd5c-44b8-92fd-7e8b107c9d23) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: INFO os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:78:f0,bridge_name='br-int',has_traffic_filtering=True,id=afff56e2-e738-461d-8d5b-92152ceb057b,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafff56e2-e7')
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:43:6f,bridge_name='br-int',has_traffic_filtering=True,id=88116839-4d5e-45d4-98bb-f5ed9d0283d7,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88116839-4d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:43:6f,bridge_name='br-int',has_traffic_filtering=True,id=88116839-4d5e-45d4-98bb-f5ed9d0283d7,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88116839-4d') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88116839-4d, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:36 user nova-compute[74587]: WARNING nova.compute.manager [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-73afc3a4-da0c-42ea-b866-75dc761137d8 for instance with vm_state active and task_state deleting.
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-unplugged-534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-534bce4c-d08f-4662-978c-432d52603ecf for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-534bce4c-d08f-4662-978c-432d52603ecf {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:36 user nova-compute[74587]: WARNING nova.compute.manager [req-5af042ae-2271-471f-b378-c577c124cb61 req-a4134245-d33f-466d-aae4-967fe6a69b15 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-534bce4c-d08f-4662-978c-432d52603ecf for instance with vm_state active and task_state deleting.
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28951058-0032-423c-8534-4ee76192cd06) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-93f81fd8-30ac-4817-9bfd-213c77d2e513 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.425s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: INFO os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:43:6f,bridge_name='br-int',has_traffic_filtering=True,id=88116839-4d5e-45d4-98bb-f5ed9d0283d7,network=Network(04497b04-6c63-42d5-a0e1-6886fd1c858c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88116839-4d')
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6e:19,bridge_name='br-int',has_traffic_filtering=True,id=6827f9e4-a725-4c88-8fa8-fc0d65263808,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6827f9e4-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6e:19,bridge_name='br-int',has_traffic_filtering=True,id=6827f9e4-a725-4c88-8fa8-fc0d65263808,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6827f9e4-a7') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6827f9e4-a7, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c088a8c-604a-4699-af5e-f0a5156788f5) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: INFO os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6e:19,bridge_name='br-int',has_traffic_filtering=True,id=6827f9e4-a725-4c88-8fa8-fc0d65263808,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6827f9e4-a7')
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354349224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354349224',id=10,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpL88V3i72ezomNuOALXeWhfA92Ax8OCUgiUKI5y/unm+3urxlk7WgmKpx9qevfCfZHvtgdmksZ9zg5dCPG54mGBUV51TK0WkO12/T74fGwfm3npgbQ40dYmg94uwlTGg==',key_name='tempest-keypair-639460329',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e03b70b00e5240b19b472ca694a97c0c',ramdisk_id='',reservation_id='r-njhhk6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1419293243',owner_user_name='tempest-TaggedBootDevicesTest_v242-1419293243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b827f4df3f55456793830f04cd97c728',uuid=fe149618-b362-4460-84d3-1b8e0e56f2f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converting VIF {"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f9:70,bridge_name='br-int',has_traffic_filtering=True,id=f55af884-f2ba-40ec-a51c-493e0f2d8c5f,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55af884-f2') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f9:70,bridge_name='br-int',has_traffic_filtering=True,id=f55af884-f2ba-40ec-a51c-493e0f2d8c5f,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55af884-f2') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf55af884-f2, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0520df1-d7a2-4c6b-b499-fa89ac0d28c4) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:36 user nova-compute[74587]: INFO os_vif [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f9:70,bridge_name='br-int',has_traffic_filtering=True,id=f55af884-f2ba-40ec-a51c-493e0f2d8c5f,network=Network(8992108a-d4db-4aa2-bd57-fb5ca943cbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55af884-f2')
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezaEDxdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:36 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[799bbeb4-4ad9-4af5-81b8-2f6464711ade]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:11:36 user nova-compute[74587]: No targets found.
Oct 18 07:11:36 user nova-compute[74587]: iSNS:
Oct 18 07:11:36 user nova-compute[74587]: No targets found.
Oct 18 07:11:36 user nova-compute[74587]: STATIC:
Oct 18 07:11:36 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5
Oct 18 07:11:36 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:36 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:36 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236
Oct 18 07:11:36 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:36 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:36 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627
Oct 18 07:11:36 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:36 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:36 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12
Oct 18 07:11:36 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:36 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:36 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:11:36 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:36 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:36 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:11:36 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:36 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:36 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae
Oct 18 07:11:36 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:36 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:36 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:11:36 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:36 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:36 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:11:36 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:36 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:36 user nova-compute[74587]: FIRMWARE:
Oct 18 07:11:36 user nova-compute[74587]: No targets found.
Oct 18 07:11:36 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:11:36 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:11:36 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c8f957-a020-4016-9564-ceca50204037]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85f58ea-b2e2-46bb-8dba-08633b7a6cf6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:36 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:36 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1008303be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12'): ({'sdd'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Removing single pathed devices sdd {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc4f112-b69f-459b-808d-17632921059a]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c238c235-53d1-48f6-b4be-78118f45583d]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Flushing IO for device /dev/sdd {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:36 user nova-compute[74587]: WARNING nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-33ce7796-efa3-4c97-8009-0b2ffb3d18a5 for instance with vm_state active and task_state deleting.
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-unplugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:36 user nova-compute[74587]: WARNING nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-88116839-4d5e-45d4-98bb-f5ed9d0283d7 for instance with vm_state active and task_state deleting.
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-unplugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:36 user nova-compute[74587]: WARNING nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-6827f9e4-a725-4c88-8fa8-fc0d65263808 for instance with vm_state active and task_state deleting.
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-unplugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-unplugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-plugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Acquiring lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] No waiting events found dispatching network-vif-plugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:36 user nova-compute[74587]: WARNING nova.compute.manager [req-fb3f027f-ba9c-4e4c-87e5-1c201aade3dd req-cd25c2aa-c409-4e03-b1c1-2688666ebb56 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received unexpected event network-vif-plugged-f55af884-f2ba-40ec-a51c-493e0f2d8c5f for instance with vm_state active and task_state deleting.
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04d42f8-da0c-413f-9e3f-9a89e8cb657a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54573bf-9466-4f70-8eb4-f373f182e590]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6700437-e66a-4202-bf10-d7dfef91520d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7022683d-044c-4d5a-bb18-dd3a4a6da540]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12, portal: 172.16.0.220,3260]
Oct 18 07:11:37 user nova-compute[74587]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d52911-fe77-4279-ac00-17cf830c6e12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2fed37-dc20-4db6-b04f-83efa71df5f3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] <== disconnect_volume: return (386ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzfrwtDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9da5b1-148d-4b59-9539-fa8d3d8163cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:11:37 user nova-compute[74587]: No targets found.
Oct 18 07:11:37 user nova-compute[74587]: iSNS:
Oct 18 07:11:37 user nova-compute[74587]: No targets found.
Oct 18 07:11:37 user nova-compute[74587]: STATIC:
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: FIRMWARE:
Oct 18 07:11:37 user nova-compute[74587]: No targets found.
Oct 18 07:11:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:11:37 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:11:37 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[932d71a8-b2bc-4547-a5ca-099ce5223e37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76d5d0c-ec3e-4aab-9796-212710ea70da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10084b4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae'): ({'sde'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Removing single pathed devices sde {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d2ab83-f633-4a0b-a624-32b4cf2a07b2]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b319c1-38cc-4be7-bb5e-5002d2db8f69]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Flushing IO for device /dev/sde {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afdad54-a5d3-4d61-be28-6020aa220524]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f688941a-07d1-4be2-9a8b-0d14b331d024]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe240f6d-2f9f-4147-8324-e4afbf6ea728]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1800e9c4-beb3-48a6-b5b1-2d19c0a89ace]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae, portal: 172.16.0.220,3260]
Oct 18 07:11:37 user nova-compute[74587]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f216cf-3b7d-4dce-9eb6-49b63181b3ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a58a3a1-f891-40e0-8802-956b6f932f31]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] <== disconnect_volume: return (351ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GrZOAyzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfc0830-3e1a-439c-a164-4d9b9bef4b33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:11:37 user nova-compute[74587]: No targets found.
Oct 18 07:11:37 user nova-compute[74587]: iSNS:
Oct 18 07:11:37 user nova-compute[74587]: No targets found.
Oct 18 07:11:37 user nova-compute[74587]: STATIC:
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:11:37 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:37 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:37 user nova-compute[74587]: FIRMWARE:
Oct 18 07:11:37 user nova-compute[74587]: No targets found.
Oct 18 07:11:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:11:37 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:11:37 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[07178a5a-cc82-4f88-bd8d-7498ab16d664]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8966a155-8dce-4835-8dca-1925890a1779]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 (non-flash)
Oct 18 07:11:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10084b4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236'): ({'sdf'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Removing single pathed devices sdf {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e93496-d4d3-424e-b680-24808a691fc4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fa838d-1946-4c92-8c18-eb857a3eff0a]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Flushing IO for device /dev/sdf {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[843f1061-1bc7-4025-8837-7d3060c9b795]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8579a9-69ab-4d87-9591-d84e907518aa]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] SCSI volumes sdf have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[471dd91f-fc24-4898-a93e-90ea28a0da2c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5291e863-9c8a-4c7d-aa81-0c292fda0d21]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236, portal: 172.16.0.220,3260]
Oct 18 07:11:37 user nova-compute[74587]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7449dd8-385c-486b-8a80-ce0c79fd4236 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e0dd31-7430-45cb-ae09-088db83c3c76]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] <== disconnect_volume: return (365ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:11:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Deleting instance files /opt/stack/data/nova/instances/fe149618-b362-4460-84d3-1b8e0e56f2f7_del
Oct 18 07:11:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Deletion of /opt/stack/data/nova/instances/fe149618-b362-4460-84d3-1b8e0e56f2f7_del complete
Oct 18 07:11:37 user nova-compute[74587]: INFO nova.compute.manager [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Took 3.65 seconds to destroy the instance on the hypervisor.
Oct 18 07:11:37 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:11:37 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:11:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:11:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:11:38 user nova-compute[74587]: INFO nova.compute.claims [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Claim successful on node user
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.compute.manager [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.compute.manager [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.policy [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a62f8993664c4570951ba81a466d61fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8810ffdaefbd441db8632657ab4e9e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:11:39 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.compute.manager [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.compute.manager [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Stashing vm_state: active {{(pid=74587) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.compute.manager [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:11:39 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Creating image(s)
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "/opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "/opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:11:39 user nova-compute[74587]: INFO nova.compute.claims [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Claim successful on node user
Oct 18 07:11:39 user nova-compute[74587]: INFO nova.compute.resource_tracker [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating resource usage from migration 701ef538-e5a8-4b17-9260-ce25d18291b4
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.217s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Successfully created port: 04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.202s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDKIUvay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '205d8114-61a9-4108-9f65-042656ad2a69', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9375339-bbe2-47a4-9083-9ec645a09ecb', 'serial': 'a9375339-bbe2-47a4-9083-9ec645a09ecb'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znsvVUtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5'}, 'status': 'reserved', 'instance': '205d8114-61a9-4108-9f65-042656ad2a69', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 'serial'} {{(pid=74587) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDKIUvay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:40 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:40 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:40 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk 1073741824" returned: 0 in 0.096s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf26435-8eed-4ad3-9b32-f48a95002d5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:11:40 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6e7950-19ee-4202-a6f1-7d1892f20207]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb] added
Oct 18 07:11:40 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[25049c3a-8024-4a2c-9805-d567233a6d33]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a98c41a-7561-4488-be92-513ad99438e4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDKIUvay {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDKIUvay" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ce5c9a-8766-4fef-bae3-16ff2717a901]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mDKIUvay'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68bba9a-07b1-4971-9063-3f2a241323dd]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.221s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13ddb75-1984-4af4-a15b-7fa2f370b406]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-ad5853df-3f66-481b-b2c0-3a18dc5a7448 req-62a9e57a-3cb3-4695-909a-c22fcd14374e service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-deleted-73afc3a4-da0c-42ea-b866-75dc761137d8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:40 user nova-compute[74587]: INFO nova.compute.manager [req-ad5853df-3f66-481b-b2c0-3a18dc5a7448 req-62a9e57a-3cb3-4695-909a-c22fcd14374e service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Neutron deleted interface 73afc3a4-da0c-42ea-b866-75dc761137d8; detaching it from the instance and deleting it from the info cache
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-ad5853df-3f66-481b-b2c0-3a18dc5a7448 req-62a9e57a-3cb3-4695-909a-c22fcd14374e service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [{"id": "534bce4c-d08f-4662-978c-432d52603ecf", "address": "fa:16:3e:8b:6c:5e", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534bce4c-d0", "ovs_interfaceid": "534bce4c-d08f-4662-978c-432d52603ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "address": "fa:16:3e:46:51:45", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ce7796-ef", "ovs_interfaceid": "33ce7796-efa3-4c97-8009-0b2ffb3d18a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afff56e2-e738-461d-8d5b-92152ceb057b", "address": "fa:16:3e:2d:78:f0", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafff56e2-e7", "ovs_interfaceid": "afff56e2-e738-461d-8d5b-92152ceb057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "address": "fa:16:3e:35:43:6f", "network": {"id": "04497b04-6c63-42d5-a0e1-6886fd1c858c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1042049291", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88116839-4d", "ovs_interfaceid": "88116839-4d5e-45d4-98bb-f5ed9d0283d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "address": "fa:16:3e:c1:6e:19", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6827f9e4-a7", "ovs_interfaceid": "6827f9e4-a725-4c88-8fa8-fc0d65263808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "address": "fa:16:3e:6b:f9:70", "network": {"id": "8992108a-d4db-4aa2-bd57-fb5ca943cbaf", "bridge": "br-int", "label": "tempest-device-tagging-net2-562959660", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e03b70b00e5240b19b472ca694a97c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55af884-f2", "ovs_interfaceid": "f55af884-f2ba-40ec-a51c-493e0f2d8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-ad5853df-3f66-481b-b2c0-3a18dc5a7448 req-62a9e57a-3cb3-4695-909a-c22fcd14374e service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Detach interface failed, port_id=73afc3a4-da0c-42ea-b866-75dc761137d8, reason: Instance fe149618-b362-4460-84d3-1b8e0e56f2f7 could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a321c68-3a52-4b76-a934-de06245d41b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260]
Oct 18 07:11:40 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:40 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a2bbc-28f5-41b7-8041-de072f0c10b0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.865s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:40 user nova-compute[74587]: INFO nova.compute.manager [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Migrating
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:11:40 user nova-compute[74587]: INFO nova.compute.rpcapi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Cannot resize image /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Ensure instance console log exists: /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca61c0-bb80-4c1f-84e9-cca1db8f0d93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:40 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:40 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:40 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.508s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquired lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36eff3b-2ed6-4d57-b518-0134240fdaf2]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDKIUvay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Successfully updated port: 04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "refresh_cache-ee417f6a-1100-4418-a4fe-e5f1f6062e3b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquired lock "refresh_cache-ee417f6a-1100-4418-a4fe-e5f1f6062e3b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-9e57af50-8f26-4b74-b403-a56c7074ec85 req-60f5d95c-e28a-4ac5-b5d2-89d72f3782c9 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Received event network-changed-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-9e57af50-8f26-4b74-b403-a56c7074ec85 req-60f5d95c-e28a-4ac5-b5d2-89d72f3782c9 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Refreshing instance network info cache due to event network-changed-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9e57af50-8f26-4b74-b403-a56c7074ec85 req-60f5d95c-e28a-4ac5-b5d2-89d72f3782c9 service nova] Acquiring lock "refresh_cache-ee417f6a-1100-4418-a4fe-e5f1f6062e3b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:11:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.network.neutron [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Updating instance_info_cache with network_info: [{"id": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "address": "fa:16:3e:91:0b:52", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e29fd8-8f", "ovs_interfaceid": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Releasing lock "refresh_cache-ee417f6a-1100-4418-a4fe-e5f1f6062e3b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Instance network_info: |[{"id": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "address": "fa:16:3e:91:0b:52", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e29fd8-8f", "ovs_interfaceid": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9e57af50-8f26-4b74-b403-a56c7074ec85 req-60f5d95c-e28a-4ac5-b5d2-89d72f3782c9 service nova] Acquired lock "refresh_cache-ee417f6a-1100-4418-a4fe-e5f1f6062e3b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.network.neutron [req-9e57af50-8f26-4b74-b403-a56c7074ec85 req-60f5d95c-e28a-4ac5-b5d2-89d72f3782c9 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Refreshing network info cache for port 04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Start _get_guest_xml network_info=[{"id": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "address": "fa:16:3e:91:0b:52", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e29fd8-8f", "ovs_interfaceid": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:11:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:11:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-144451901',display_name='tempest-VolumesAdminNegativeTest-server-144451901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-144451901',id=13,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8810ffdaefbd441db8632657ab4e9e60',ramdisk_id='',reservation_id='r-0z8tuu9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-312543909',owner_user_name='tempest-VolumesAdminNegativeTest-312543909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:11:40Z,user_data=None,user_id='a62f8993664c4570951ba81a466d61fd',uuid=ee417f6a-1100-4418-a4fe-e5f1f6062e3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "address": "fa:16:3e:91:0b:52", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e29fd8-8f", "ovs_interfaceid": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converting VIF {"id": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "address": "fa:16:3e:91:0b:52", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e29fd8-8f", "ovs_interfaceid": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=04e29fd8-8f24-4fc5-9bf2-a7b8f033a947,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e29fd8-8f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.objects.instance [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lazy-loading 'pci_devices' on Instance uuid ee417f6a-1100-4418-a4fe-e5f1f6062e3b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.network.neutron [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating instance_info_cache with network_info: [{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:11:41 user nova-compute[74587]:   <uuid>ee417f6a-1100-4418-a4fe-e5f1f6062e3b</uuid>
Oct 18 07:11:41 user nova-compute[74587]:   <name>instance-0000000d</name>
Oct 18 07:11:41 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:11:41 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:11:41 user nova-compute[74587]:   <metadata>
Oct 18 07:11:41 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:11:41 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:11:41 user nova-compute[74587]:       <nova:name>tempest-VolumesAdminNegativeTest-server-144451901</nova:name>
Oct 18 07:11:41 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:11:41</nova:creationTime>
Oct 18 07:11:41 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:11:41 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:11:41 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:11:41 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:11:41 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:11:41 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:11:41 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:11:41 user nova-compute[74587]:       <nova:owner>
Oct 18 07:11:41 user nova-compute[74587]:         <nova:user uuid="a62f8993664c4570951ba81a466d61fd">tempest-VolumesAdminNegativeTest-312543909-project-member</nova:user>
Oct 18 07:11:41 user nova-compute[74587]:         <nova:project uuid="8810ffdaefbd441db8632657ab4e9e60">tempest-VolumesAdminNegativeTest-312543909</nova:project>
Oct 18 07:11:41 user nova-compute[74587]:       </nova:owner>
Oct 18 07:11:41 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:11:41 user nova-compute[74587]:       <nova:ports>
Oct 18 07:11:41 user nova-compute[74587]:         <nova:port uuid="04e29fd8-8f24-4fc5-9bf2-a7b8f033a947">
Oct 18 07:11:41 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 07:11:41 user nova-compute[74587]:         </nova:port>
Oct 18 07:11:41 user nova-compute[74587]:       </nova:ports>
Oct 18 07:11:41 user nova-compute[74587]:     </nova:instance>
Oct 18 07:11:41 user nova-compute[74587]:   </metadata>
Oct 18 07:11:41 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:11:41 user nova-compute[74587]:     <system>
Oct 18 07:11:41 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:11:41 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:11:41 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:11:41 user nova-compute[74587]:       <entry name="serial">ee417f6a-1100-4418-a4fe-e5f1f6062e3b</entry>
Oct 18 07:11:41 user nova-compute[74587]:       <entry name="uuid">ee417f6a-1100-4418-a4fe-e5f1f6062e3b</entry>
Oct 18 07:11:41 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:11:41 user nova-compute[74587]:     </system>
Oct 18 07:11:41 user nova-compute[74587]:   </sysinfo>
Oct 18 07:11:41 user nova-compute[74587]:   <os>
Oct 18 07:11:41 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:11:41 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:11:41 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:11:41 user nova-compute[74587]:   </os>
Oct 18 07:11:41 user nova-compute[74587]:   <features>
Oct 18 07:11:41 user nova-compute[74587]:     <acpi/>
Oct 18 07:11:41 user nova-compute[74587]:     <apic/>
Oct 18 07:11:41 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:11:41 user nova-compute[74587]:   </features>
Oct 18 07:11:41 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:11:41 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:11:41 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:11:41 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:11:41 user nova-compute[74587]:   </clock>
Oct 18 07:11:41 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:11:41 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:11:41 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:11:41 user nova-compute[74587]:   </cpu>
Oct 18 07:11:41 user nova-compute[74587]:   <devices>
Oct 18 07:11:41 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:11:41 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:11:41 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk"/>
Oct 18 07:11:41 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:11:41 user nova-compute[74587]:     </disk>
Oct 18 07:11:41 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:11:41 user nova-compute[74587]:       <mac address="fa:16:3e:91:0b:52"/>
Oct 18 07:11:41 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:11:41 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:11:41 user nova-compute[74587]:       <target dev="tap04e29fd8-8f"/>
Oct 18 07:11:41 user nova-compute[74587]:     </interface>
Oct 18 07:11:41 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:11:41 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/console.log" append="off"/>
Oct 18 07:11:41 user nova-compute[74587]:     </serial>
Oct 18 07:11:41 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:11:41 user nova-compute[74587]:     <video>
Oct 18 07:11:41 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:11:41 user nova-compute[74587]:     </video>
Oct 18 07:11:41 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:11:41 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:11:41 user nova-compute[74587]:     </rng>
Oct 18 07:11:41 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:11:41 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:11:41 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:11:41 user nova-compute[74587]:     </memballoon>
Oct 18 07:11:41 user nova-compute[74587]:   </devices>
Oct 18 07:11:41 user nova-compute[74587]: </domain>
Oct 18 07:11:41 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-144451901',display_name='tempest-VolumesAdminNegativeTest-server-144451901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-144451901',id=13,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8810ffdaefbd441db8632657ab4e9e60',ramdisk_id='',reservation_id='r-0z8tuu9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-312543909',owner_user_name='tempest-VolumesAdminNegativeTest-312543909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:11:40Z,user_data=None,user_id='a62f8993664c4570951ba81a466d61fd',uuid=ee417f6a-1100-4418-a4fe-e5f1f6062e3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "address": "fa:16:3e:91:0b:52", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e29fd8-8f", "ovs_interfaceid": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converting VIF {"id": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "address": "fa:16:3e:91:0b:52", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e29fd8-8f", "ovs_interfaceid": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=04e29fd8-8f24-4fc5-9bf2-a7b8f033a947,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e29fd8-8f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG os_vif [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=04e29fd8-8f24-4fc5-9bf2-a7b8f033a947,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e29fd8-8f') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Releasing lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '246a57f1-360c-5ba2-8637-ff5717666881', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04e29fd8-8f, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04e29fd8-8f, col_values=(('qos', UUID('1f3b54f5-ece3-43a3-a437-704bd9e9088c')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04e29fd8-8f, col_values=(('external_ids', {'iface-id': '04e29fd8-8f24-4fc5-9bf2-a7b8f033a947', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:0b:52', 'vm-uuid': 'ee417f6a-1100-4418-a4fe-e5f1f6062e3b'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: INFO os_vif [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=04e29fd8-8f24-4fc5-9bf2-a7b8f033a947,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e29fd8-8f')
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] No VIF found with MAC fa:16:3e:91:0b:52, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Starting migrate_disk_and_power_off {{(pid=74587) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.network.neutron [req-9e57af50-8f26-4b74-b403-a56c7074ec85 req-60f5d95c-e28a-4ac5-b5d2-89d72f3782c9 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Updated VIF entry in instance network info cache for port 04e29fd8-8f24-4fc5-9bf2-a7b8f033a947. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.network.neutron [req-9e57af50-8f26-4b74-b403-a56c7074ec85 req-60f5d95c-e28a-4ac5-b5d2-89d72f3782c9 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Updating instance_info_cache with network_info: [{"id": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "address": "fa:16:3e:91:0b:52", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e29fd8-8f", "ovs_interfaceid": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.570s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] <== connect_volume: return (1577ms) {'type': 'block', 'scsi_wwn': '26436633038366161', 'path': '/dev/sdd'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436633038366161', 'path': '/dev/sdd'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9e57af50-8f26-4b74-b403-a56c7074ec85 req-60f5d95c-e28a-4ac5-b5d2-89d72f3782c9 service nova] Releasing lock "refresh_cache-ee417f6a-1100-4418-a4fe-e5f1f6062e3b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:11:41 user nova-compute[74587]: DEBUG nova.objects.instance [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lazy-loading 'flavor' on Instance uuid 205d8114-61a9-4108-9f65-042656ad2a69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:42 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Took 4.19 seconds to deallocate network for instance.
Oct 18 07:11:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-6ee48a15-a3bf-488d-b882-6961cd5889a8 req-3bf037b0-1a40-423c-a4c4-505e3e0af018 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-deleted-afff56e2-e738-461d-8d5b-92152ceb057b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-6ee48a15-a3bf-488d-b882-6961cd5889a8 req-3bf037b0-1a40-423c-a4c4-505e3e0af018 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-deleted-6827f9e4-a725-4c88-8fa8-fc0d65263808 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-6ee48a15-a3bf-488d-b882-6961cd5889a8 req-3bf037b0-1a40-423c-a4c4-505e3e0af018 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-deleted-f55af884-f2ba-40ec-a51c-493e0f2d8c5f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-6ee48a15-a3bf-488d-b882-6961cd5889a8 req-3bf037b0-1a40-423c-a4c4-505e3e0af018 service nova] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Received event network-vif-deleted-88116839-4d5e-45d4-98bb-f5ed9d0283d7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance destroyed successfully.
Oct 18 07:11:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-755684932',display_name='tempest-ServerActionsTestOtherB-server-755684932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-755684932',id=4,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8stB7NcHNVX73tIwXaWmwjt5Z5Gy40wrIxjnndsSfNN8+LA5rjRswbgNHk/MPUZkNT6gLl8Vo+PjF4hhdbnZF62iCxOpmdu8UPwTjCHb48/H//aH3JFzmyPPPDesN3zA==',key_name='tempest-keypair-1877047546',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='658a7454d9f14afbb50a0588fa3da19f',ramdisk_id='',reservation_id='r-kaimmc3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2137467099',owner_user_name='tempest-ServerActionsTestOtherB-2137467099-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:11:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc135a6446545888ff24712eefb1b3e',uuid=dc1910eb-a1c1-4310-ba25-42ac6e4d724b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-175791086-network", "vif_mac": "fa:16:3e:1a:0b:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converting VIF {"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-175791086-network", "vif_mac": "fa:16:3e:1a:0b:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG os_vif [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f61b2a7-a7, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a39d8756-4015-4eb3-a057-3596377c18f5) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:42 user nova-compute[74587]: INFO os_vif [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7')
Oct 18 07:11:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:42 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-unplugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-unplugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:43 user nova-compute[74587]: WARNING nova.compute.manager [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-unplugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state active and task_state resize_migrating.
Oct 18 07:11:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:43 user nova-compute[74587]: WARNING nova.compute.manager [req-c7c771b2-beb7-44a1-b1e9-39047e992b80 req-3517d3f6-b630-4f57-a6e0-85c32f116020 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state active and task_state resize_migrating.
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c59583f-7266-4e16-8371-901ed87c6758]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:11:43 user nova-compute[74587]: No targets found.
Oct 18 07:11:43 user nova-compute[74587]: iSNS:
Oct 18 07:11:43 user nova-compute[74587]: No targets found.
Oct 18 07:11:43 user nova-compute[74587]: STATIC:
Oct 18 07:11:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5
Oct 18 07:11:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627
Oct 18 07:11:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb
Oct 18 07:11:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:11:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:11:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:11:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:11:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:43 user nova-compute[74587]: FIRMWARE:
Oct 18 07:11:43 user nova-compute[74587]: No targets found.
Oct 18 07:11:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:11:43 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:11:43 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7c26c3-af48-4937-8ddc-97d727843a7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af1515-9371-4784-bcdb-6cd324f5c0a7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:11:43 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46ae200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627'): ({'sdg'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Removing single pathed devices sdg {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b06d58c-bc29-4641-8a17-20f471da3b94]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2808ace7-3b8a-4322-a635-d8a24e4f3ff9]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Flushing IO for device /dev/sdg {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f5c682-b708-4c63-9da4-639f2033cce3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.070s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96b20ce-f0f4-4ed5-8d7d-31497b040e28]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] SCSI volumes sdg have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde69512-c6f9-4ffd-923f-0d2870077008]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[41389939-f84b-45ba-9279-55bffa7a69d0]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]
Oct 18 07:11:43 user nova-compute[74587]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 160432128 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dd2ef2-e255-41b7-9cda-679e530b433d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.514s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] <== disconnect_volume: return (519ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 277872640 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b_resize/disk /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-c18756b4-e509-43bb-ab36-b7140a27a9b6 req-4d307e61-adbe-4f36-856a-f4dc7be777bf service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Received event network-vif-plugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c18756b4-e509-43bb-ab36-b7140a27a9b6 req-4d307e61-adbe-4f36-856a-f4dc7be777bf service nova] Acquiring lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c18756b4-e509-43bb-ab36-b7140a27a9b6 req-4d307e61-adbe-4f36-856a-f4dc7be777bf service nova] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c18756b4-e509-43bb-ab36-b7140a27a9b6 req-4d307e61-adbe-4f36-856a-f4dc7be777bf service nova] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-c18756b4-e509-43bb-ab36-b7140a27a9b6 req-4d307e61-adbe-4f36-856a-f4dc7be777bf service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] No waiting events found dispatching network-vif-plugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:44 user nova-compute[74587]: WARNING nova.compute.manager [req-c18756b4-e509-43bb-ab36-b7140a27a9b6 req-4d307e61-adbe-4f36-856a-f4dc7be777bf service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Received unexpected event network-vif-plugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 for instance with vm_state building and task_state spawning.
Oct 18 07:11:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 419430400 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "cp -r /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b_resize/disk /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk" returned: 0 in 0.591s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b_resize/disk.info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk.info {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "cp -r /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b_resize/disk.info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk.info" returned: 0 in 0.037s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 564133888 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 642777088 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:45 user nova-compute[74587]: INFO nova.compute.manager [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] [instance: fe149618-b362-4460-84d3-1b8e0e56f2f7] Took 3.78 seconds to detach 3 volumes for instance.
Oct 18 07:11:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 758120448 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-af1f4e2a-292b-4ea3-8e09-5b3b87e4abfa req-93eb270d-47c4-46f4-b842-04a89929277c service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Received event network-vif-plugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-af1f4e2a-292b-4ea3-8e09-5b3b87e4abfa req-93eb270d-47c4-46f4-b842-04a89929277c service nova] Acquiring lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-af1f4e2a-292b-4ea3-8e09-5b3b87e4abfa req-93eb270d-47c4-46f4-b842-04a89929277c service nova] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-af1f4e2a-292b-4ea3-8e09-5b3b87e4abfa req-93eb270d-47c4-46f4-b842-04a89929277c service nova] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-af1f4e2a-292b-4ea3-8e09-5b3b87e4abfa req-93eb270d-47c4-46f4-b842-04a89929277c service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] No waiting events found dispatching network-vif-plugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:46 user nova-compute[74587]: WARNING nova.compute.manager [req-af1f4e2a-292b-4ea3-8e09-5b3b87e4abfa req-93eb270d-47c4-46f4-b842-04a89929277c service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Received unexpected event network-vif-plugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 for instance with vm_state building and task_state spawning.
Oct 18 07:11:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:11:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Instance spawned successfully.
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 862978048 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.network.neutron [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Port 1f61b2a7-a701-4ffd-bf37-76309f8f9b5a binding to destination host user is already ACTIVE {{(pid=74587) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.623s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:46 user nova-compute[74587]: INFO nova.compute.manager [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Took 7.01 seconds to spawn the instance on the hypervisor.
Oct 18 07:11:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:11:46 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Deleted allocations for instance fe149618-b362-4460-84d3-1b8e0e56f2f7
Oct 18 07:11:46 user nova-compute[74587]: INFO nova.compute.manager [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Took 8.12 seconds to build instance.
Oct 18 07:11:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-722a7996-f011-4a78-9ceb-c01a5583f964 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.471s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 914358272 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4dc06024-db63-4201-8ae4-8c54a923d3e6 tempest-TaggedBootDevicesTest_v242-1419293243 tempest-TaggedBootDevicesTest_v242-1419293243-project-member] Lock "fe149618-b362-4460-84d3-1b8e0e56f2f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.839s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:11:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquired lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:11:47 user nova-compute[74587]: DEBUG nova.network.neutron [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:11:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 1015021568 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:47 user nova-compute[74587]: DEBUG nova.network.neutron [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating instance_info_cache with network_info: [{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Releasing lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:11:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.utils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a25a68-d97e-4c7f-b9de-67e84747a569]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73d60fe-732f-45f6-9fa1-ae2f3960369b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[955f86df-9ab7-414b-831b-3a7fc61555b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcad045c-0ed6-46a0-ad1d-4060e619a348]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:11:48 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c96e74-7784-4ccc-86c5-133d66926fe4]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.utils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znsvVUtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:11:48 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[283dab54-050e-4dfb-bbb7-1eb7d3df8554]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:11:48 user nova-compute[74587]: No targets found.
Oct 18 07:11:48 user nova-compute[74587]: iSNS:
Oct 18 07:11:48 user nova-compute[74587]: No targets found.
Oct 18 07:11:48 user nova-compute[74587]: STATIC:
Oct 18 07:11:48 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5
Oct 18 07:11:48 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:48 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:48 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb
Oct 18 07:11:48 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:48 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:48 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:11:48 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:48 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:48 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:11:48 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:48 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:48 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:11:48 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:48 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:48 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:11:48 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:11:48 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:11:48 user nova-compute[74587]: FIRMWARE:
Oct 18 07:11:48 user nova-compute[74587]: No targets found.
Oct 18 07:11:48 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:11:48 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:11:48 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3612896-a16d-4dd8-9bd3-725d7565fe66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdf52dd-c5c7-45ca-acc2-3a1b4dd05cde]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:48 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:48 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:48 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:48 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:48 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:48 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:11:48 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:11:48 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:11:48 user nova-compute[74587]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 (non-flash)
Oct 18 07:11:48 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:11:48 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:11:48 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4505d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9fc680-a2f5-4e31-a3ca-3c5e427afdb4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[594173cb-fa49-4c17-a603-394b6525a94c]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f160399a-d60a-4c12-a448-34ad08774fcf]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea603a2-8697-4cb2-9277-d0bfee7b4de9]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0655fe-ff56-47de-b6d5-1895d7ce382a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccdef1d-a495-4080-a79e-94650fe2cc61]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5, portal: 172.16.0.220,3260]
Oct 18 07:11:48 user nova-compute[74587]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5, portal: 172.16.0.220,3260] successful.
Oct 18 07:11:48 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.172s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d0c0db-727c-4acd-80eb-5d84252868d4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.515s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] <== disconnect_volume: return (517ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDKIUvay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '205d8114-61a9-4108-9f65-042656ad2a69', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9375339-bbe2-47a4-9083-9ec645a09ecb', 'serial'} {{(pid=74587) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 18 07:11:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] swap_volume: removing Cinder connection for volume b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 {{(pid=74587) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 18 07:11:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] swap_volume: Updating volume b7c076a4-cf83-42a9-93f9-fcb5ee4a19d5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "mDKIUvay", "auth_password": "x27Fu8z9cXEAqV", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "a9375339-bbe2-47a4-9083-9ec645a09ecb"}, "status": "reserved", "instance": "205d8114-61a9-4108-9f65-042656ad2a69", "attached_at": "", "detached_at": "", "volume_id": "a9375339-bbe2-47a4-9083-9ec645a09ecb", "serial": "a9375339-bbe2-47a4-9083-9ec645a09ecb"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a9375339-bbe2-47a4-9083-9ec645a09ecb', 'no_device': None, 'attachment_id': '2a986d16-3cf9-409e-8270-a68645279c36'} {{(pid=74587) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 18 07:11:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7321003f-366b-4de4-bbcb-20f6ebee0a70 tempest-TestVolumeSwap-484589371 tempest-TestVolumeSwap-484589371-project-admin] Lock "205d8114-61a9-4108-9f65-042656ad2a69" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 30.984s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:50 user nova-compute[74587]: INFO nova.compute.manager [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Detaching volume a9375339-bbe2-47a4-9083-9ec645a09ecb
Oct 18 07:11:50 user nova-compute[74587]: INFO nova.virt.block_device [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Attempting to driver detach volume a9375339-bbe2-47a4-9083-9ec645a09ecb from mountpoint /dev/vdb
Oct 18 07:11:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Attempting to detach device vdb from instance 205d8114-61a9-4108-9f65-042656ad2a69 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:11:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:11:50 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:11:50 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:11:50 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:11:50 user nova-compute[74587]:   <serial>a9375339-bbe2-47a4-9083-9ec645a09ecb</serial>
Oct 18 07:11:50 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:11:50 user nova-compute[74587]: </disk>
Oct 18 07:11:50 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:11:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Successfully detached device vdb from instance 205d8114-61a9-4108-9f65-042656ad2a69 from the persistent domain config.
Oct 18 07:11:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 205d8114-61a9-4108-9f65-042656ad2a69 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:11:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:11:50 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:11:50 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:11:50 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:11:50 user nova-compute[74587]:   <serial>a9375339-bbe2-47a4-9083-9ec645a09ecb</serial>
Oct 18 07:11:50 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:11:50 user nova-compute[74587]: </disk>
Oct 18 07:11:50 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:11:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 205d8114-61a9-4108-9f65-042656ad2a69 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:11:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Acquiring lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Acquiring lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:55 user nova-compute[74587]: INFO nova.compute.manager [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Terminating instance
Oct 18 07:11:55 user nova-compute[74587]: DEBUG nova.compute.manager [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:11:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-e21a2019-c0cf-4ac8-b315-e3436869dc31 req-bdd1cf59-779a-4a2a-a81d-e1f3ff02ad3f service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received event network-vif-unplugged-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e21a2019-c0cf-4ac8-b315-e3436869dc31 req-bdd1cf59-779a-4a2a-a81d-e1f3ff02ad3f service nova] Acquiring lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e21a2019-c0cf-4ac8-b315-e3436869dc31 req-bdd1cf59-779a-4a2a-a81d-e1f3ff02ad3f service nova] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e21a2019-c0cf-4ac8-b315-e3436869dc31 req-bdd1cf59-779a-4a2a-a81d-e1f3ff02ad3f service nova] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-e21a2019-c0cf-4ac8-b315-e3436869dc31 req-bdd1cf59-779a-4a2a-a81d-e1f3ff02ad3f service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] No waiting events found dispatching network-vif-unplugged-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-e21a2019-c0cf-4ac8-b315-e3436869dc31 req-bdd1cf59-779a-4a2a-a81d-e1f3ff02ad3f service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received event network-vif-unplugged-c050b165-f76e-484d-a030-09f32640e911 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:11:56 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Instance destroyed successfully.
Oct 18 07:11:56 user nova-compute[74587]: DEBUG nova.objects.instance [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lazy-loading 'resources' on Instance uuid fe0bd998-4fb1-45fc-a2c3-c3486c54754d {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1426431396',display_name='tempest-VolumesAssistedSnapshotsTest-server-1426431396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1426431396',id=9,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Vw5HV6E3TkbC4pqqyGnZv30BM/nrSMxLYgbMIpeg49vo+/sBUx7GIpjirtDHrd5FFPfjoma7xT2H+r0DrfBu1V1YeExG1nY3iBjdBygLK2nCqusGNVSHhQKcnejaFNg==',key_name='tempest-keypair-116029123',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:08:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21f5692171db4aed9cbee623607ec665',ramdisk_id='',reservation_id='r-gic31dbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-551656722',owner_user_name='tempest-VolumesAssistedSnapshotsTest-551656722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26c1fb8d1cfb44228dfa8a26efd27bc6',uuid=fe0bd998-4fb1-45fc-a2c3-c3486c54754d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Converting VIF {"id": "c050b165-f76e-484d-a030-09f32640e911", "address": "fa:16:3e:5e:72:85", "network": {"id": "bbdefb28-8928-4c79-9272-25b05020c4ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277288693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f5692171db4aed9cbee623607ec665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc050b165-f7", "ovs_interfaceid": "c050b165-f76e-484d-a030-09f32640e911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:72:85,bridge_name='br-int',has_traffic_filtering=True,id=c050b165-f76e-484d-a030-09f32640e911,network=Network(bbdefb28-8928-4c79-9272-25b05020c4ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc050b165-f7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG os_vif [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:72:85,bridge_name='br-int',has_traffic_filtering=True,id=c050b165-f76e-484d-a030-09f32640e911,network=Network(bbdefb28-8928-4c79-9272-25b05020c4ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc050b165-f7') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc050b165-f7, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=701a55bc-98b2-44a9-9186-5ce8b934c9c9) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:11:56 user nova-compute[74587]: INFO os_vif [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:72:85,bridge_name='br-int',has_traffic_filtering=True,id=c050b165-f76e-484d-a030-09f32640e911,network=Network(bbdefb28-8928-4c79-9272-25b05020c4ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc050b165-f7')
Oct 18 07:11:56 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Deleting instance files /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d_del
Oct 18 07:11:56 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Deletion of /opt/stack/data/nova/instances/fe0bd998-4fb1-45fc-a2c3-c3486c54754d_del complete
Oct 18 07:11:56 user nova-compute[74587]: INFO nova.compute.manager [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 18 07:11:56 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:11:56 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:11:57 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:11:57 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Took 0.73 seconds to deallocate network for instance.
Oct 18 07:11:57 user nova-compute[74587]: DEBUG nova.compute.manager [req-b37910cd-b21e-4ca0-a65a-f0dbd8488001 req-ff762008-0c4c-444c-a91c-d85875e7fd93 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received event network-vif-deleted-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:57 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:11:57 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:11:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:58 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Deleted allocations for instance fe0bd998-4fb1-45fc-a2c3-c3486c54754d
Oct 18 07:11:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-259f5226-9e30-4d83-8db6-d886f34b127e tempest-VolumesAssistedSnapshotsTest-551656722 tempest-VolumesAssistedSnapshotsTest-551656722-project-member] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.280s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-a140dc62-84d6-46e9-9f43-b057c8ff02e3 req-f8c24a62-01e6-4d76-ba95-d5cf18502d73 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received event network-vif-plugged-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:11:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a140dc62-84d6-46e9-9f43-b057c8ff02e3 req-f8c24a62-01e6-4d76-ba95-d5cf18502d73 service nova] Acquiring lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:11:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a140dc62-84d6-46e9-9f43-b057c8ff02e3 req-f8c24a62-01e6-4d76-ba95-d5cf18502d73 service nova] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:11:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a140dc62-84d6-46e9-9f43-b057c8ff02e3 req-f8c24a62-01e6-4d76-ba95-d5cf18502d73 service nova] Lock "fe0bd998-4fb1-45fc-a2c3-c3486c54754d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:11:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-a140dc62-84d6-46e9-9f43-b057c8ff02e3 req-f8c24a62-01e6-4d76-ba95-d5cf18502d73 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] No waiting events found dispatching network-vif-plugged-c050b165-f76e-484d-a030-09f32640e911 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:11:58 user nova-compute[74587]: WARNING nova.compute.manager [req-a140dc62-84d6-46e9-9f43-b057c8ff02e3 req-f8c24a62-01e6-4d76-ba95-d5cf18502d73 service nova] [instance: fe0bd998-4fb1-45fc-a2c3-c3486c54754d] Received unexpected event network-vif-plugged-c050b165-f76e-484d-a030-09f32640e911 for instance with vm_state deleted and task_state None.
Oct 18 07:11:59 user nova-compute[74587]: INFO nova.compute.manager [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Rescuing
Oct 18 07:11:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:11:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquired lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:11:59 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:11:59 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updating instance_info_cache with network_info: [{"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Releasing lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-a1437309-b4f7-430e-95c2-7c5cb115408b req-73f88924-f404-46a4-9d00-ac24a37a39c1 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-unplugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a1437309-b4f7-430e-95c2-7c5cb115408b req-73f88924-f404-46a4-9d00-ac24a37a39c1 service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a1437309-b4f7-430e-95c2-7c5cb115408b req-73f88924-f404-46a4-9d00-ac24a37a39c1 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a1437309-b4f7-430e-95c2-7c5cb115408b req-73f88924-f404-46a4-9d00-ac24a37a39c1 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-a1437309-b4f7-430e-95c2-7c5cb115408b req-73f88924-f404-46a4-9d00-ac24a37a39c1 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-unplugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:00 user nova-compute[74587]: WARNING nova.compute.manager [req-a1437309-b4f7-430e-95c2-7c5cb115408b req-73f88924-f404-46a4-9d00-ac24a37a39c1 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-unplugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state active and task_state rescuing.
Oct 18 07:12:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Instance destroyed successfully.
Oct 18 07:12:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Attempting rescue
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74587) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Instance directory exists: not creating {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 07:12:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Creating image(s)
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue" returned: 0 in 0.055s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'migration_context' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.objects.base [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<0d568195-c89b-47e8-9992-bfc3a6c8e929> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Start _get_guest_xml network_info=[{"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "vif_mac": "fa:16:3e:5f:50:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'resources' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.objects.base [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<0d568195-c89b-47e8-9992-bfc3a6c8e929> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:12:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.objects.base [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<0d568195-c89b-47e8-9992-bfc3a6c8e929> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:12:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:12:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.objects.base [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<0d568195-c89b-47e8-9992-bfc3a6c8e929> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1612933739',display_name='tempest-ServerRescueNegativeTestJSON-server-1612933739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1612933739',id=1,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-ungvr3bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:07:28Z,user_data=None,user_id='96efd41052434514aea7fe47a5eb36f7',uuid=0d568195-c89b-47e8-9992-bfc3a6c8e929,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "vif_mac": "fa:16:3e:5f:50:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "vif_mac": "fa:16:3e:5f:50:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:50:bd,bridge_name='br-int',has_traffic_filtering=True,id=338116e1-ec57-4c95-987e-d6d72a2b50b3,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338116e1-ec') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.objects.base [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<0d568195-c89b-47e8-9992-bfc3a6c8e929> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:12:01 user nova-compute[74587]:   <uuid>0d568195-c89b-47e8-9992-bfc3a6c8e929</uuid>
Oct 18 07:12:01 user nova-compute[74587]:   <name>instance-00000001</name>
Oct 18 07:12:01 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:12:01 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:12:01 user nova-compute[74587]:   <metadata>
Oct 18 07:12:01 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:12:01 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:12:01 user nova-compute[74587]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1612933739</nova:name>
Oct 18 07:12:01 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:12:01</nova:creationTime>
Oct 18 07:12:01 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:12:01 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:12:01 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:12:01 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:12:01 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:12:01 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:12:01 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:12:01 user nova-compute[74587]:       <nova:owner>
Oct 18 07:12:01 user nova-compute[74587]:         <nova:user uuid="96efd41052434514aea7fe47a5eb36f7">tempest-ServerRescueNegativeTestJSON-1222499333-project-member</nova:user>
Oct 18 07:12:01 user nova-compute[74587]:         <nova:project uuid="1b1dbea9d8d34471b74b5c002f5905f0">tempest-ServerRescueNegativeTestJSON-1222499333</nova:project>
Oct 18 07:12:01 user nova-compute[74587]:       </nova:owner>
Oct 18 07:12:01 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:12:01 user nova-compute[74587]:       <nova:ports>
Oct 18 07:12:01 user nova-compute[74587]:         <nova:port uuid="338116e1-ec57-4c95-987e-d6d72a2b50b3">
Oct 18 07:12:01 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 07:12:01 user nova-compute[74587]:         </nova:port>
Oct 18 07:12:01 user nova-compute[74587]:       </nova:ports>
Oct 18 07:12:01 user nova-compute[74587]:     </nova:instance>
Oct 18 07:12:01 user nova-compute[74587]:   </metadata>
Oct 18 07:12:01 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:12:01 user nova-compute[74587]:     <system>
Oct 18 07:12:01 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:12:01 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:12:01 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:12:01 user nova-compute[74587]:       <entry name="serial">0d568195-c89b-47e8-9992-bfc3a6c8e929</entry>
Oct 18 07:12:01 user nova-compute[74587]:       <entry name="uuid">0d568195-c89b-47e8-9992-bfc3a6c8e929</entry>
Oct 18 07:12:01 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:12:01 user nova-compute[74587]:     </system>
Oct 18 07:12:01 user nova-compute[74587]:   </sysinfo>
Oct 18 07:12:01 user nova-compute[74587]:   <os>
Oct 18 07:12:01 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:12:01 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:12:01 user nova-compute[74587]:   </os>
Oct 18 07:12:01 user nova-compute[74587]:   <features>
Oct 18 07:12:01 user nova-compute[74587]:     <acpi/>
Oct 18 07:12:01 user nova-compute[74587]:     <apic/>
Oct 18 07:12:01 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:12:01 user nova-compute[74587]:   </features>
Oct 18 07:12:01 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:12:01 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:12:01 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:12:01 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:12:01 user nova-compute[74587]:   </clock>
Oct 18 07:12:01 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:12:01 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:12:01 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:12:01 user nova-compute[74587]:   </cpu>
Oct 18 07:12:01 user nova-compute[74587]:   <devices>
Oct 18 07:12:01 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:12:01 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:12:01 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue"/>
Oct 18 07:12:01 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:12:01 user nova-compute[74587]:     </disk>
Oct 18 07:12:01 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:12:01 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:12:01 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk"/>
Oct 18 07:12:01 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:12:01 user nova-compute[74587]:     </disk>
Oct 18 07:12:01 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:12:01 user nova-compute[74587]:       <mac address="fa:16:3e:5f:50:bd"/>
Oct 18 07:12:01 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:12:01 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:12:01 user nova-compute[74587]:       <target dev="tap338116e1-ec"/>
Oct 18 07:12:01 user nova-compute[74587]:     </interface>
Oct 18 07:12:01 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:12:01 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/console.log" append="off"/>
Oct 18 07:12:01 user nova-compute[74587]:     </serial>
Oct 18 07:12:01 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:12:01 user nova-compute[74587]:     <video>
Oct 18 07:12:01 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:12:01 user nova-compute[74587]:     </video>
Oct 18 07:12:01 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:12:01 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:12:01 user nova-compute[74587]:     </rng>
Oct 18 07:12:01 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:12:01 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:12:01 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:12:01 user nova-compute[74587]:     </memballoon>
Oct 18 07:12:01 user nova-compute[74587]:   </devices>
Oct 18 07:12:01 user nova-compute[74587]: </domain>
Oct 18 07:12:01 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:12:01 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Instance destroyed successfully.
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No VIF found with MAC fa:16:3e:5f:50:bd, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:12:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:02 user nova-compute[74587]: INFO nova.compute.manager [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Terminating instance
Oct 18 07:12:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-1bf11047-f41b-4984-9407-8a583100164f req-df0d35b3-a575-452f-8fbf-387e420846f3 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1bf11047-f41b-4984-9407-8a583100164f req-df0d35b3-a575-452f-8fbf-387e420846f3 service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1bf11047-f41b-4984-9407-8a583100164f req-df0d35b3-a575-452f-8fbf-387e420846f3 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1bf11047-f41b-4984-9407-8a583100164f req-df0d35b3-a575-452f-8fbf-387e420846f3 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-1bf11047-f41b-4984-9407-8a583100164f req-df0d35b3-a575-452f-8fbf-387e420846f3 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:02 user nova-compute[74587]: WARNING nova.compute.manager [req-1bf11047-f41b-4984-9407-8a583100164f req-df0d35b3-a575-452f-8fbf-387e420846f3 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state active and task_state rescuing.
Oct 18 07:12:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:03 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Instance destroyed successfully.
Oct 18 07:12:03 user nova-compute[74587]: DEBUG nova.objects.instance [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lazy-loading 'resources' on Instance uuid 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-675565366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-675565366',id=7,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEO5dx++IX4ljOuW+qNj5hpC2x51PQ/SXgUWZY1ekvFYqfyCilmR4DC2lOZdcQco8cKcpkEKyVcg6SoQUuKw0WDM3TFiS+hwHnBjz0Ph4sNwOOd+murzzpvCJKAO0syDw==',key_name='tempest-keypair-1735451947',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='884f75b337bf4ab5b239e3e1e16954ed',ramdisk_id='',reservation_id='r-6o10505b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-259044806',owner_user_name='tempest-TaggedAttachmentsTest-259044806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42bc78aefa2847238a3b25da59c9a148',uuid=2c672325-def3-49a9-a7b2-9dfb4fa0ce2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converting VIF {"id": "ddbc6964-8191-4483-8a63-2c853584be6f", "address": "fa:16:3e:9c:6f:78", "network": {"id": "28e57b0c-679d-49b9-9797-3a4e20e525f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2029186372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "884f75b337bf4ab5b239e3e1e16954ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddbc6964-81", "ovs_interfaceid": "ddbc6964-8191-4483-8a63-2c853584be6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=ddbc6964-8191-4483-8a63-2c853584be6f,network=Network(28e57b0c-679d-49b9-9797-3a4e20e525f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbc6964-81') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG os_vif [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=ddbc6964-8191-4483-8a63-2c853584be6f,network=Network(28e57b0c-679d-49b9-9797-3a4e20e525f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbc6964-81') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddbc6964-81, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7f7c3fa-b095-4a5d-9ce8-7e7a5c63a1ae) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:03 user nova-compute[74587]: INFO os_vif [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=ddbc6964-8191-4483-8a63-2c853584be6f,network=Network(28e57b0c-679d-49b9-9797-3a4e20e525f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddbc6964-81')
Oct 18 07:12:03 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Deleting instance files /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c_del
Oct 18 07:12:03 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Deletion of /opt/stack/data/nova/instances/2c672325-def3-49a9-a7b2-9dfb4fa0ce2c_del complete
Oct 18 07:12:03 user nova-compute[74587]: INFO nova.compute.manager [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Took 1.38 seconds to destroy the instance on the hypervisor.
Oct 18 07:12:03 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:12:03 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-unplugged-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] No waiting events found dispatching network-vif-unplugged-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-unplugged-ddbc6964-8191-4483-8a63-2c853584be6f for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-plugged-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Acquiring lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] No waiting events found dispatching network-vif-plugged-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:04 user nova-compute[74587]: WARNING nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received unexpected event network-vif-plugged-ddbc6964-8191-4483-8a63-2c853584be6f for instance with vm_state active and task_state deleting.
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:04 user nova-compute[74587]: WARNING nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state active and task_state rescuing.
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:04 user nova-compute[74587]: WARNING nova.compute.manager [req-4d2f5f16-dce4-4178-bef4-f53c83039db5 req-9c4bb174-942c-400b-841f-af0f4c6fe39e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state active and task_state rescuing.
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-6c1f3813-efe5-442d-9771-dc85e8129808 req-2bf680e2-a41c-475b-bd2a-2b6073a34fa4 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Received event network-vif-deleted-ddbc6964-8191-4483-8a63-2c853584be6f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:04 user nova-compute[74587]: INFO nova.compute.manager [req-6c1f3813-efe5-442d-9771-dc85e8129808 req-2bf680e2-a41c-475b-bd2a-2b6073a34fa4 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Neutron deleted interface ddbc6964-8191-4483-8a63-2c853584be6f; detaching it from the instance and deleting it from the info cache
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.network.neutron [req-6c1f3813-efe5-442d-9771-dc85e8129808 req-2bf680e2-a41c-475b-bd2a-2b6073a34fa4 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:12:04 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Took 0.95 seconds to deallocate network for instance.
Oct 18 07:12:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-6c1f3813-efe5-442d-9771-dc85e8129808 req-2bf680e2-a41c-475b-bd2a-2b6073a34fa4 service nova] [instance: 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c] Detach interface failed, port_id=ddbc6964-8191-4483-8a63-2c853584be6f, reason: Instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:05 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:12:05 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:12:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:05 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Deleted allocations for instance 2c672325-def3-49a9-a7b2-9dfb4fa0ce2c
Oct 18 07:12:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2994dff6-eaf4-4721-838d-4222d277706b tempest-TaggedAttachmentsTest-259044806 tempest-TaggedAttachmentsTest-259044806-project-member] Lock "2c672325-def3-49a9-a7b2-9dfb4fa0ce2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.959s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:05 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:12:05 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c0e8b492-34cb-42c2-a034-692a925c11c2 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:12:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:12:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Starting finish_migration {{(pid=74587) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 18 07:12:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance directory exists: not creating {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 07:12:07 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Creating image(s)
Oct 18 07:12:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.238s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:07 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk. size=21474836480 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:12:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk 21474836480 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk 21474836480" returned: 0 in 0.045s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Ensure instance console log exists: /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Start _get_guest_xml network_info=[{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-175791086-network", "vif_mac": "fa:16:3e:1a:0b:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd34cb152-eff4-42c3-9c09-12b3bfa09313', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dc1910eb-a1c1-4310-ba25-42ac6e4d724b', 'attached_at': '2023-10-18T07:12:07.000000', 'detached_at': '', 'volume_id': '06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'serial': '06c33e07-1a17-4c2f-9a1b-d0818eb03627'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:12:08 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:12:08 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:12:08 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:12:08 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:12:08 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a52009-8751-4c56-8f9a-4b44264a662d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:12:08 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eb4750-143e-498e-bce8-8e2150880e6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627] added
Oct 18 07:12:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[568eceeb-cbb6-4522-ae94-786dd2916216]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a7bbff-85c8-434f-94a8-46e5bd84dab3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycHXUMWF {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycHXUMWF" returned: 0 in 0.045s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d83eab-d1bd-42b6-9dc0-526d121a6b2a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycHXUMWF'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[618d1037-93c7-413c-a53c-eda1a129d1de]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d2b1ad-70f6-46d2-a8e7-06af44bd416b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:12:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:12:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4fadd4-48f3-45d3-9527-40aadb1a51f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]
Oct 18 07:12:08 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.
Oct 18 07:12:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3788f21-7f58-4eb7-adb5-966785cf1835]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e87acf5-3f0d-4e84-be26-9f52e727c7ab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:12:08 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[715f8d2f-306e-4695-95e6-4af907948998]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:12:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '23661366165336330', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661366165336330', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-755684932',display_name='tempest-ServerActionsTestOtherB-server-755684932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-755684932',id=4,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8stB7NcHNVX73tIwXaWmwjt5Z5Gy40wrIxjnndsSfNN8+LA5rjRswbgNHk/MPUZkNT6gLl8Vo+PjF4hhdbnZF62iCxOpmdu8UPwTjCHb48/H//aH3JFzmyPPPDesN3zA==',key_name='tempest-keypair-1877047546',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='658a7454d9f14afbb50a0588fa3da19f',ramdisk_id='',reservation_id='r-kaimmc3g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2137467099',owner_user_name='tempest-ServerActionsTestOtherB-2137467099-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc135a6446545888ff24712eefb1b3e',uuid=dc1910eb-a1c1-4310-ba25-42ac6e4d724b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-175791086-network", "vif_mac": "fa:16:3e:1a:0b:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converting VIF {"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-175791086-network", "vif_mac": "fa:16:3e:1a:0b:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:12:09 user nova-compute[74587]:   <uuid>dc1910eb-a1c1-4310-ba25-42ac6e4d724b</uuid>
Oct 18 07:12:09 user nova-compute[74587]:   <name>instance-00000004</name>
Oct 18 07:12:09 user nova-compute[74587]:   <memory>2097152</memory>
Oct 18 07:12:09 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:12:09 user nova-compute[74587]:   <metadata>
Oct 18 07:12:09 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:12:09 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:12:09 user nova-compute[74587]:       <nova:name>tempest-ServerActionsTestOtherB-server-755684932</nova:name>
Oct 18 07:12:09 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:12:08</nova:creationTime>
Oct 18 07:12:09 user nova-compute[74587]:       <nova:flavor name="m1.small">
Oct 18 07:12:09 user nova-compute[74587]:         <nova:memory>2048</nova:memory>
Oct 18 07:12:09 user nova-compute[74587]:         <nova:disk>20</nova:disk>
Oct 18 07:12:09 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:12:09 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:12:09 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:12:09 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:12:09 user nova-compute[74587]:       <nova:owner>
Oct 18 07:12:09 user nova-compute[74587]:         <nova:user uuid="1fc135a6446545888ff24712eefb1b3e">tempest-ServerActionsTestOtherB-2137467099-project-member</nova:user>
Oct 18 07:12:09 user nova-compute[74587]:         <nova:project uuid="658a7454d9f14afbb50a0588fa3da19f">tempest-ServerActionsTestOtherB-2137467099</nova:project>
Oct 18 07:12:09 user nova-compute[74587]:       </nova:owner>
Oct 18 07:12:09 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:12:09 user nova-compute[74587]:       <nova:ports>
Oct 18 07:12:09 user nova-compute[74587]:         <nova:port uuid="1f61b2a7-a701-4ffd-bf37-76309f8f9b5a">
Oct 18 07:12:09 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 07:12:09 user nova-compute[74587]:         </nova:port>
Oct 18 07:12:09 user nova-compute[74587]:       </nova:ports>
Oct 18 07:12:09 user nova-compute[74587]:     </nova:instance>
Oct 18 07:12:09 user nova-compute[74587]:   </metadata>
Oct 18 07:12:09 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:12:09 user nova-compute[74587]:     <system>
Oct 18 07:12:09 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:12:09 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:12:09 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:12:09 user nova-compute[74587]:       <entry name="serial">dc1910eb-a1c1-4310-ba25-42ac6e4d724b</entry>
Oct 18 07:12:09 user nova-compute[74587]:       <entry name="uuid">dc1910eb-a1c1-4310-ba25-42ac6e4d724b</entry>
Oct 18 07:12:09 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:12:09 user nova-compute[74587]:     </system>
Oct 18 07:12:09 user nova-compute[74587]:   </sysinfo>
Oct 18 07:12:09 user nova-compute[74587]:   <os>
Oct 18 07:12:09 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:12:09 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:12:09 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:12:09 user nova-compute[74587]:   </os>
Oct 18 07:12:09 user nova-compute[74587]:   <features>
Oct 18 07:12:09 user nova-compute[74587]:     <acpi/>
Oct 18 07:12:09 user nova-compute[74587]:     <apic/>
Oct 18 07:12:09 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:12:09 user nova-compute[74587]:   </features>
Oct 18 07:12:09 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:12:09 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:12:09 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:12:09 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:12:09 user nova-compute[74587]:   </clock>
Oct 18 07:12:09 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:12:09 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:12:09 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:12:09 user nova-compute[74587]:   </cpu>
Oct 18 07:12:09 user nova-compute[74587]:   <devices>
Oct 18 07:12:09 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:12:09 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:12:09 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk"/>
Oct 18 07:12:09 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:12:09 user nova-compute[74587]:     </disk>
Oct 18 07:12:09 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:12:09 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:12:09 user nova-compute[74587]:       <source dev="/dev/sdb"/>
Oct 18 07:12:09 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:12:09 user nova-compute[74587]:       <serial>06c33e07-1a17-4c2f-9a1b-d0818eb03627</serial>
Oct 18 07:12:09 user nova-compute[74587]:     </disk>
Oct 18 07:12:09 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:12:09 user nova-compute[74587]:       <mac address="fa:16:3e:1a:0b:de"/>
Oct 18 07:12:09 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:12:09 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:12:09 user nova-compute[74587]:       <target dev="tap1f61b2a7-a7"/>
Oct 18 07:12:09 user nova-compute[74587]:     </interface>
Oct 18 07:12:09 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:12:09 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/console.log" append="off"/>
Oct 18 07:12:09 user nova-compute[74587]:     </serial>
Oct 18 07:12:09 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:12:09 user nova-compute[74587]:     <video>
Oct 18 07:12:09 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:12:09 user nova-compute[74587]:     </video>
Oct 18 07:12:09 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:12:09 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:12:09 user nova-compute[74587]:     </rng>
Oct 18 07:12:09 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:12:09 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:12:09 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:12:09 user nova-compute[74587]:     </memballoon>
Oct 18 07:12:09 user nova-compute[74587]:   </devices>
Oct 18 07:12:09 user nova-compute[74587]: </domain>
Oct 18 07:12:09 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-755684932',display_name='tempest-ServerActionsTestOtherB-server-755684932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-755684932',id=4,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8stB7NcHNVX73tIwXaWmwjt5Z5Gy40wrIxjnndsSfNN8+LA5rjRswbgNHk/MPUZkNT6gLl8Vo+PjF4hhdbnZF62iCxOpmdu8UPwTjCHb48/H//aH3JFzmyPPPDesN3zA==',key_name='tempest-keypair-1877047546',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='658a7454d9f14afbb50a0588fa3da19f',ramdisk_id='',reservation_id='r-kaimmc3g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2137467099',owner_user_name='tempest-ServerActionsTestOtherB-2137467099-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc135a6446545888ff24712eefb1b3e',uuid=dc1910eb-a1c1-4310-ba25-42ac6e4d724b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-175791086-network", "vif_mac": "fa:16:3e:1a:0b:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converting VIF {"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-175791086-network", "vif_mac": "fa:16:3e:1a:0b:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG os_vif [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6c1b0ab-7ed6-5b97-90e0-aed1c2dd7ebe', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f61b2a7-a7, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f61b2a7-a7, col_values=(('qos', UUID('74666cfc-e11f-4bef-8a45-45218ab73514')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f61b2a7-a7, col_values=(('external_ids', {'iface-id': '1f61b2a7-a701-4ffd-bf37-76309f8f9b5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:0b:de', 'vm-uuid': 'dc1910eb-a1c1-4310-ba25-42ac6e4d724b'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:09 user nova-compute[74587]: INFO os_vif [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7')
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:12:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] No VIF found with MAC fa:16:3e:1a:0b:de, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Updating instance_info_cache with network_info: [{"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:12:10 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 205d8114-61a9-4108-9f65-042656ad2a69 is timed out.
Oct 18 07:12:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Successfully detached device vdb from instance 205d8114-61a9-4108-9f65-042656ad2a69 from the live domain config.
Oct 18 07:12:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDKIUvay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'a9375339-bbe2-47a4-9083-9ec645a09ecb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:12:10 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:12:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:12:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fafa56-bd59-4b79-8f91-6b03137e2b16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:12:11 user nova-compute[74587]: No targets found.
Oct 18 07:12:11 user nova-compute[74587]: iSNS:
Oct 18 07:12:11 user nova-compute[74587]: No targets found.
Oct 18 07:12:11 user nova-compute[74587]: STATIC:
Oct 18 07:12:11 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627
Oct 18 07:12:11 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:11 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:11 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb
Oct 18 07:12:11 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:11 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:11 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:12:11 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:11 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:11 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:12:11 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:11 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:11 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:12:11 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:11 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:11 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:12:11 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:11 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:11 user nova-compute[74587]: FIRMWARE:
Oct 18 07:12:11 user nova-compute[74587]: No targets found.
Oct 18 07:12:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:12:11 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:12:11 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b221fb-96d1-4ad6-af7a-e2db4aad561d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf45597-cfa6-47d5-94b3-603afbcf70a8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:12:11 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:12:11 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:11 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:11 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:12:11 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:12:11 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:12:11 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:11 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:11 user nova-compute[74587]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb (non-flash)
Oct 18 07:12:11 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10087aeef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb'): ({'sdd'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Removing single pathed devices sdd {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a9a8ae-196e-4daa-9166-918007cf1e14]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6cf920-e2b8-4c5b-933a-baf1a1ee7c26]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Flushing IO for device /dev/sdd {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a019cdd6-a749-4f8b-83ed-1a4dc30ca13b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81afd72-0876-4fab-8df5-2e67d0d5bcf2]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a11891-604b-48b9-be0f-424459180e22]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[067d80ea-a29f-4a7c-982b-a7b8209e318d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260]
Oct 18 07:12:11 user nova-compute[74587]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb, portal: 172.16.0.220,3260] successful.
Oct 18 07:12:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9375339-bbe2-47a4-9083-9ec645a09ecb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d48e5-995a-4df7-bab6-f8b6ed29e509]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] <== disconnect_volume: return (406ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-e11c1365-e0fa-45e7-b4c5-4333a84eaf87 req-c6e2406b-ebf5-4f47-b8e7-604f4f55ed52 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e11c1365-e0fa-45e7-b4c5-4333a84eaf87 req-c6e2406b-ebf5-4f47-b8e7-604f4f55ed52 service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e11c1365-e0fa-45e7-b4c5-4333a84eaf87 req-c6e2406b-ebf5-4f47-b8e7-604f4f55ed52 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e11c1365-e0fa-45e7-b4c5-4333a84eaf87 req-c6e2406b-ebf5-4f47-b8e7-604f4f55ed52 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-e11c1365-e0fa-45e7-b4c5-4333a84eaf87 req-c6e2406b-ebf5-4f47-b8e7-604f4f55ed52 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:11 user nova-compute[74587]: WARNING nova.compute.manager [req-e11c1365-e0fa-45e7-b4c5-4333a84eaf87 req-c6e2406b-ebf5-4f47-b8e7-604f4f55ed52 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state active and task_state resize_finish.
Oct 18 07:12:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lazy-loading 'flavor' on Instance uuid 205d8114-61a9-4108-9f65-042656ad2a69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-72f666d4-b497-4d8b-bd1e-0d9455d0838d tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.372s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:12:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-44af489c-915f-4b6e-a2f6-143208369883 req-ea98573e-c5da-47f6-a087-0b2a9e81d707 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-44af489c-915f-4b6e-a2f6-143208369883 req-ea98573e-c5da-47f6-a087-0b2a9e81d707 service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-44af489c-915f-4b6e-a2f6-143208369883 req-ea98573e-c5da-47f6-a087-0b2a9e81d707 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-44af489c-915f-4b6e-a2f6-143208369883 req-ea98573e-c5da-47f6-a087-0b2a9e81d707 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-44af489c-915f-4b6e-a2f6-143208369883 req-ea98573e-c5da-47f6-a087-0b2a9e81d707 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:13 user nova-compute[74587]: WARNING nova.compute.manager [req-44af489c-915f-4b6e-a2f6-143208369883 req-ea98573e-c5da-47f6-a087-0b2a9e81d707 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state active and task_state resize_finish.
Oct 18 07:12:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:12:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance running successfully.
Oct 18 07:12:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Failed to set time: agent not configured {{(pid=74587) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cd87bbdb-15cb-4ce7-ae22-e0e253560d5d tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] finish_migration finished successfully. {{(pid=74587) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdl (vdc) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:16 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:12:16 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7808MB free_disk=25.549362182617188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Applying migration context for instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b as it has an incoming, in-progress migration 701ef538-e5a8-4b17-9260-ce25d18291b4. Migration status is finished {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 18 07:12:16 user nova-compute[74587]: INFO nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating resource usage from migration 701ef538-e5a8-4b17-9260-ce25d18291b4
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 205d8114-61a9-4108-9f65-042656ad2a69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance c17be69f-69e9-455c-9f83-5b2851b1d646 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee417f6a-1100-4418-a4fe-e5f1f6062e3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Migration 701ef538-e5a8-4b17-9260-ce25d18291b4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:12:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:12:17 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:12:17 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:12:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:12:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:12:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:12:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-379a069c-7408-430e-9a97-c93f1c97d560 req-efb31d5c-09f4-4e11-8468-c129554cdcda service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-changed-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-379a069c-7408-430e-9a97-c93f1c97d560 req-efb31d5c-09f4-4e11-8468-c129554cdcda service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing instance network info cache due to event network-changed-04ebae1c-d00a-46dd-8afa-2c8c24c04848. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:12:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-379a069c-7408-430e-9a97-c93f1c97d560 req-efb31d5c-09f4-4e11-8468-c129554cdcda service nova] Acquiring lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:12:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-379a069c-7408-430e-9a97-c93f1c97d560 req-efb31d5c-09f4-4e11-8468-c129554cdcda service nova] Acquired lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:12:37 user nova-compute[74587]: DEBUG nova.network.neutron [req-379a069c-7408-430e-9a97-c93f1c97d560 req-efb31d5c-09f4-4e11-8468-c129554cdcda service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Refreshing network info cache for port 04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:12:38 user nova-compute[74587]: DEBUG nova.network.neutron [req-379a069c-7408-430e-9a97-c93f1c97d560 req-efb31d5c-09f4-4e11-8468-c129554cdcda service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updated VIF entry in instance network info cache for port 04ebae1c-d00a-46dd-8afa-2c8c24c04848. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:12:38 user nova-compute[74587]: DEBUG nova.network.neutron [req-379a069c-7408-430e-9a97-c93f1c97d560 req-efb31d5c-09f4-4e11-8468-c129554cdcda service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [{"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:12:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-379a069c-7408-430e-9a97-c93f1c97d560 req-efb31d5c-09f4-4e11-8468-c129554cdcda service nova] Releasing lock "refresh_cache-c17be69f-69e9-455c-9f83-5b2851b1d646" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:12:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:40 user nova-compute[74587]: INFO nova.compute.manager [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Terminating instance
Oct 18 07:12:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:40 user nova-compute[74587]: INFO nova.compute.manager [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Terminating instance
Oct 18 07:12:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-7b6f692d-f5c3-43bb-9823-6cca5cfd3017 req-f3c4ffcf-7bf5-4134-9239-957200fe11d9 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7b6f692d-f5c3-43bb-9823-6cca5cfd3017 req-f3c4ffcf-7bf5-4134-9239-957200fe11d9 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7b6f692d-f5c3-43bb-9823-6cca5cfd3017 req-f3c4ffcf-7bf5-4134-9239-957200fe11d9 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7b6f692d-f5c3-43bb-9823-6cca5cfd3017 req-f3c4ffcf-7bf5-4134-9239-957200fe11d9 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-7b6f692d-f5c3-43bb-9823-6cca5cfd3017 req-f3c4ffcf-7bf5-4134-9239-957200fe11d9 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-unplugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-7b6f692d-f5c3-43bb-9823-6cca5cfd3017 req-f3c4ffcf-7bf5-4134-9239-957200fe11d9 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-69f2e47e-0e12-4985-8207-91042cdf9320 req-a6875940-f352-476b-b8a2-65d3af86377a service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69f2e47e-0e12-4985-8207-91042cdf9320 req-a6875940-f352-476b-b8a2-65d3af86377a service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69f2e47e-0e12-4985-8207-91042cdf9320 req-a6875940-f352-476b-b8a2-65d3af86377a service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69f2e47e-0e12-4985-8207-91042cdf9320 req-a6875940-f352-476b-b8a2-65d3af86377a service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-69f2e47e-0e12-4985-8207-91042cdf9320 req-a6875940-f352-476b-b8a2-65d3af86377a service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-unplugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-69f2e47e-0e12-4985-8207-91042cdf9320 req-a6875940-f352-476b-b8a2-65d3af86377a service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-94c11713-2884-4c81-82c0-85aefbfeb5dc req-c243bda8-2593-4a1f-9949-ffc82e1009cf service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-94c11713-2884-4c81-82c0-85aefbfeb5dc req-c243bda8-2593-4a1f-9949-ffc82e1009cf service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-94c11713-2884-4c81-82c0-85aefbfeb5dc req-c243bda8-2593-4a1f-9949-ffc82e1009cf service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-94c11713-2884-4c81-82c0-85aefbfeb5dc req-c243bda8-2593-4a1f-9949-ffc82e1009cf service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-94c11713-2884-4c81-82c0-85aefbfeb5dc req-c243bda8-2593-4a1f-9949-ffc82e1009cf service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-unplugged-f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-94c11713-2884-4c81-82c0-85aefbfeb5dc req-c243bda8-2593-4a1f-9949-ffc82e1009cf service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-f194c977-6d80-481e-aee6-31acfc3f10f8 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Instance destroyed successfully.
Oct 18 07:12:42 user nova-compute[74587]: DEBUG nova.objects.instance [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lazy-loading 'resources' on Instance uuid 205d8114-61a9-4108-9f65-042656ad2a69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1414595523',display_name='tempest-TestVolumeSwap-server-1414595523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1414595523',id=8,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOD93BRu4BfvWIVxkN4tYPyBr48X0UyyR7krQVr3p719JxSGUPEhgbW0FhU5zHPS6GTaG2UhCCT+ZI9O6eaBgN40H+XZ6eXoy5/u9cVs2oIAT056YjTI1tHmF2ys3aJxw==',key_name='tempest-keypair-410090200',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad5bfc6e6c3e4a31a776c8039fb68cdb',ramdisk_id='',reservation_id='r-o78w5439',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1036758189',owner_user_name='tempest-TestVolumeSwap-1036758189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e30aa1cbe46c4bf6a8a82e3c8adff031',uuid=205d8114-61a9-4108-9f65-042656ad2a69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Converting VIF {"id": "0d782334-b135-4c85-94f5-45c448d3256c", "address": "fa:16:3e:d2:59:28", "network": {"id": "7e67c4af-793f-4669-a7e1-9a890f0a3d5c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2089957201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad5bfc6e6c3e4a31a776c8039fb68cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d782334-b1", "ovs_interfaceid": "0d782334-b135-4c85-94f5-45c448d3256c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:59:28,bridge_name='br-int',has_traffic_filtering=True,id=0d782334-b135-4c85-94f5-45c448d3256c,network=Network(7e67c4af-793f-4669-a7e1-9a890f0a3d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d782334-b1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG os_vif [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:59:28,bridge_name='br-int',has_traffic_filtering=True,id=0d782334-b135-4c85-94f5-45c448d3256c,network=Network(7e67c4af-793f-4669-a7e1-9a890f0a3d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d782334-b1') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d782334-b1, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57bfffa2-6249-4916-bfb9-59c355b76af4) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: INFO os_vif [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:59:28,bridge_name='br-int',has_traffic_filtering=True,id=0d782334-b135-4c85-94f5-45c448d3256c,network=Network(7e67c4af-793f-4669-a7e1-9a890f0a3d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d782334-b1')
Oct 18 07:12:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Deleting instance files /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69_del
Oct 18 07:12:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Deletion of /opt/stack/data/nova/instances/205d8114-61a9-4108-9f65-042656ad2a69_del complete
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: INFO nova.compute.manager [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Took 1.69 seconds to destroy the instance on the hypervisor.
Oct 18 07:12:42 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Instance destroyed successfully.
Oct 18 07:12:42 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lazy-loading 'resources' on Instance uuid c17be69f-69e9-455c-9f83-5b2851b1d646 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "address": "fa:16:3e:d0:2f:c1", "network": {"id": "77e234c2-b9d9-42f3-8879-5f4244839d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1529925984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ebae1c-d0", "ovs_interfaceid": "04ebae1c-d00a-46dd-8afa-2c8c24c04848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:2f:c1,bridge_name='br-int',has_traffic_filtering=True,id=04ebae1c-d00a-46dd-8afa-2c8c24c04848,network=Network(77e234c2-b9d9-42f3-8879-5f4244839d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ebae1c-d0') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:2f:c1,bridge_name='br-int',has_traffic_filtering=True,id=04ebae1c-d00a-46dd-8afa-2c8c24c04848,network=Network(77e234c2-b9d9-42f3-8879-5f4244839d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ebae1c-d0') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ebae1c-d0, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29746622-8413-49de-918d-b86dfc40609f) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: INFO os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:2f:c1,bridge_name='br-int',has_traffic_filtering=True,id=04ebae1c-d00a-46dd-8afa-2c8c24c04848,network=Network(77e234c2-b9d9-42f3-8879-5f4244839d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ebae1c-d0')
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ae:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ebc9f00-5c') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ae:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ebc9f00-5c') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ebc9f00-5c, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64b821b3-9061-480d-a316-b702c360a1fb) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: WARNING nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f for instance with vm_state active and task_state deleting.
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-unplugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: WARNING nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-74e6c08f-3e16-430b-bc6d-c2ea430c75b2 for instance with vm_state active and task_state deleting.
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-unplugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: WARNING nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 for instance with vm_state active and task_state deleting.
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-unplugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: WARNING nova.compute.manager [req-72f0a302-2eb6-402a-ab72-3a2c00e59251 req-45570919-2436-4e49-ae51-80d2668982db service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-b48ddaee-bb23-4b91-b54b-9c0ca783f780 for instance with vm_state active and task_state deleting.
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: INFO os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ae:d7,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ebc9f00-5c')
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:1b,bridge_name='br-int',has_traffic_filtering=True,id=74e6c08f-3e16-430b-bc6d-c2ea430c75b2,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74e6c08f-3e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:1b,bridge_name='br-int',has_traffic_filtering=True,id=74e6c08f-3e16-430b-bc6d-c2ea430c75b2,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74e6c08f-3e') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74e6c08f-3e, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1b3fc7a-54bb-447f-899e-69161aced52e) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: INFO os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:1b,bridge_name='br-int',has_traffic_filtering=True,id=74e6c08f-3e16-430b-bc6d-c2ea430c75b2,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74e6c08f-3e')
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:c3,bridge_name='br-int',has_traffic_filtering=True,id=f194c977-6d80-481e-aee6-31acfc3f10f8,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf194c977-6d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:c3,bridge_name='br-int',has_traffic_filtering=True,id=f194c977-6d80-481e-aee6-31acfc3f10f8,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf194c977-6d') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf194c977-6d, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-b50b84cb-a7b4-447c-9f34-9f11e96157d3 req-abf0aa35-d385-4dcc-9402-4e1905f4eb85 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b50b84cb-a7b4-447c-9f34-9f11e96157d3 req-abf0aa35-d385-4dcc-9402-4e1905f4eb85 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b50b84cb-a7b4-447c-9f34-9f11e96157d3 req-abf0aa35-d385-4dcc-9402-4e1905f4eb85 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b50b84cb-a7b4-447c-9f34-9f11e96157d3 req-abf0aa35-d385-4dcc-9402-4e1905f4eb85 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-b50b84cb-a7b4-447c-9f34-9f11e96157d3 req-abf0aa35-d385-4dcc-9402-4e1905f4eb85 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: WARNING nova.compute.manager [req-b50b84cb-a7b4-447c-9f34-9f11e96157d3 req-abf0aa35-d385-4dcc-9402-4e1905f4eb85 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-04ebae1c-d00a-46dd-8afa-2c8c24c04848 for instance with vm_state active and task_state deleting.
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebd08164-afc6-4ed1-bcdd-57d83fe79cb3) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: INFO os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:c3,bridge_name='br-int',has_traffic_filtering=True,id=f194c977-6d80-481e-aee6-31acfc3f10f8,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf194c977-6d')
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:37:73,bridge_name='br-int',has_traffic_filtering=True,id=2e30d3ed-1d43-4cc9-b452-eeb149c007a7,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30d3ed-1d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:37:73,bridge_name='br-int',has_traffic_filtering=True,id=2e30d3ed-1d43-4cc9-b452-eeb149c007a7,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30d3ed-1d') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e30d3ed-1d, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14e9d991-80c6-4641-be41-825e9ed59715) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: INFO os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:37:73,bridge_name='br-int',has_traffic_filtering=True,id=2e30d3ed-1d43-4cc9-b452-eeb149c007a7,network=Network(51ad2a20-8da1-415c-879a-259a32710c64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30d3ed-1d')
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d8:95,bridge_name='br-int',has_traffic_filtering=True,id=1ceed310-b30b-4ea9-88d7-6fb43a041bb8,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ceed310-b3') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d8:95,bridge_name='br-int',has_traffic_filtering=True,id=1ceed310-b30b-4ea9-88d7-6fb43a041bb8,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ceed310-b3') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ceed310-b3, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8531a45c-0f49-401f-a7f8-4e7525cac9d0) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: INFO os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d8:95,bridge_name='br-int',has_traffic_filtering=True,id=1ceed310-b30b-4ea9-88d7-6fb43a041bb8,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ceed310-b3')
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T07:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1049905819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1049905819',id=11,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbnO5R+10NrCLNjvJCn1WakSFpGWeJSLjBfs0DuKbjAe09DFQgy8olMf4QSOvdiopWX99PphsozgKmpFvQ8x5FJZQI5xuwKij3LhvAVoSWfYiPsi8tKhWjX+CBkGtwB8g==',key_name='tempest-keypair-1467065565',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba117ef53fc64403ad516a9860cb28f1',ramdisk_id='',reservation_id='r-uw00f0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-150279486',owner_user_name='tempest-TaggedBootDevicesTest-150279486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04930d45ee104e2f91e46e277bf1f77f',uuid=c17be69f-69e9-455c-9f83-5b2851b1d646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converting VIF {"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:17:0e,bridge_name='br-int',has_traffic_filtering=True,id=b48ddaee-bb23-4b91-b54b-9c0ca783f780,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48ddaee-bb') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:17:0e,bridge_name='br-int',has_traffic_filtering=True,id=b48ddaee-bb23-4b91-b54b-9c0ca783f780,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48ddaee-bb') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb48ddaee-bb, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=021860db-269b-4d68-9592-cd3e8173e5c1) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:43 user nova-compute[74587]: INFO os_vif [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:17:0e,bridge_name='br-int',has_traffic_filtering=True,id=b48ddaee-bb23-4b91-b54b-9c0ca783f780,network=Network(4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48ddaee-bb')
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OebvFzhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:12:43 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4ac17b-0fc5-4ae6-af0e-bd11258f670c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:12:43 user nova-compute[74587]: No targets found.
Oct 18 07:12:43 user nova-compute[74587]: iSNS:
Oct 18 07:12:43 user nova-compute[74587]: No targets found.
Oct 18 07:12:43 user nova-compute[74587]: STATIC:
Oct 18 07:12:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627
Oct 18 07:12:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:12:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:12:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49
Oct 18 07:12:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:12:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:43 user nova-compute[74587]: FIRMWARE:
Oct 18 07:12:43 user nova-compute[74587]: No targets found.
Oct 18 07:12:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:12:43 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:12:43 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[697fd1e1-9c65-48a6-8bd5-fdef70534496]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfbfadf-2af6-4213-92c8-09c32d7e7ce8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:12:43 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:12:43 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:43 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:43 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 (non-flash)
Oct 18 07:12:43 user nova-compute[74587]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:12:43 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:43 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:43 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4505630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49'): ({'sdj'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Removing single pathed devices sdj {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:12:43 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Took 0.99 seconds to deallocate network for instance.
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: WARNING nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-f194c977-6d80-481e-aee6-31acfc3f10f8 for instance with vm_state active and task_state deleting.
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received event network-vif-unplugged-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Lock "205d8114-61a9-4108-9f65-042656ad2a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Lock "205d8114-61a9-4108-9f65-042656ad2a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] No waiting events found dispatching network-vif-unplugged-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received event network-vif-unplugged-0d782334-b135-4c85-94f5-45c448d3256c for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received event network-vif-plugged-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Acquiring lock "205d8114-61a9-4108-9f65-042656ad2a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Lock "205d8114-61a9-4108-9f65-042656ad2a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Lock "205d8114-61a9-4108-9f65-042656ad2a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] No waiting events found dispatching network-vif-plugged-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: WARNING nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received unexpected event network-vif-plugged-0d782334-b135-4c85-94f5-45c448d3256c for instance with vm_state active and task_state deleting.
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-unplugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-unplugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-plugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Acquiring lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] No waiting events found dispatching network-vif-plugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:43 user nova-compute[74587]: WARNING nova.compute.manager [req-5f6e8781-640e-4dd7-9e6a-d9616a44f63b req-20a5f9cb-fc83-4492-bed1-5c7dfa2ffe63 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received unexpected event network-vif-plugged-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 for instance with vm_state active and task_state deleting.
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a7951-60e0-4afd-ad0b-9c36db24031f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb44bfb3-507e-47c2-82f2-f7fcf3137da4]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Flushing IO for device /dev/sdj {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[38646c2f-e236-43ed-8aa6-63f32ccc4bf4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.035s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec5447a-09ee-4d69-a327-dd4a9e0edd36]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] SCSI volumes sdj have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa30e02-0ceb-4815-824a-fd2e2ac1f9ab]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1b2d14-b105-4824-9a20-174167108416]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49, portal: 172.16.0.220,3260]
Oct 18 07:12:43 user nova-compute[74587]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49, portal: 172.16.0.220,3260] successful.
Oct 18 07:12:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18305be1-6d3d-4b8f-bd30-0ea5ef2d0a49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[528fb324-87d7-4ee3-9f39-9baced89ed2f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] <== disconnect_volume: return (408ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFZPfjYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:12:43 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3dfab8-a3f9-45be-a937-97549e0a1931]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:12:43 user nova-compute[74587]: No targets found.
Oct 18 07:12:43 user nova-compute[74587]: iSNS:
Oct 18 07:12:43 user nova-compute[74587]: No targets found.
Oct 18 07:12:43 user nova-compute[74587]: STATIC:
Oct 18 07:12:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627
Oct 18 07:12:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63
Oct 18 07:12:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:12:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:12:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:43 user nova-compute[74587]: FIRMWARE:
Oct 18 07:12:43 user nova-compute[74587]: No targets found.
Oct 18 07:12:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:12:43 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:12:43 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b117c0-94cf-4fd1-a53d-c1f630147cd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[778c873c-bc37-4b0d-b53e-8f966744f556]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:12:44 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:44 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:44 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 (non-flash)
Oct 18 07:12:44 user nova-compute[74587]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:44 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:44 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1008302830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63'): ({'sdk'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Removing single pathed devices sdk {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[01155cd2-92dd-4bed-a703-39bfb6ad3faa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[276c473a-a979-4e8c-af90-acac3af3632f]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Flushing IO for device /dev/sdk {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0286076a-2280-443b-9f04-001de1df8416]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.042s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f095e46-8fcb-44ac-8992-2ddb97cd73a7]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] SCSI volumes sdk have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6326c837-2d0a-4783-b621-53dcbc148b47]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Deleted allocations for instance 205d8114-61a9-4108-9f65-042656ad2a69
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[120270c9-8c39-450b-8f8f-34dfdf8e6727]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63, portal: 172.16.0.220,3260]
Oct 18 07:12:44 user nova-compute[74587]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63, portal: 172.16.0.220,3260] successful.
Oct 18 07:12:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e76c0dc-dc0c-4508-a142-8aa97ba64e63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa18f72-f4f5-4f61-954a-307fb691a192]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] <== disconnect_volume: return (380ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqfupRZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:12:44 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d6a746-5de9-426a-851f-c5ec8777cac7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:12:44 user nova-compute[74587]: No targets found.
Oct 18 07:12:44 user nova-compute[74587]: iSNS:
Oct 18 07:12:44 user nova-compute[74587]: No targets found.
Oct 18 07:12:44 user nova-compute[74587]: STATIC:
Oct 18 07:12:44 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627
Oct 18 07:12:44 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:44 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:44 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8
Oct 18 07:12:44 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:44 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:44 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:12:44 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:12:44 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:12:44 user nova-compute[74587]: FIRMWARE:
Oct 18 07:12:44 user nova-compute[74587]: No targets found.
Oct 18 07:12:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:12:44 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:12:44 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5f1c2c66-31fb-4e37-87f7-084c712bc967 tempest-TestVolumeSwap-1036758189 tempest-TestVolumeSwap-1036758189-project-member] Lock "205d8114-61a9-4108-9f65-042656ad2a69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.432s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[994a13e4-a7bc-45e3-aa74-20474bca9793]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6619206-7b41-418f-ac49-13850b4429cf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:44 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:44 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 (non-flash)
Oct 18 07:12:44 user nova-compute[74587]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:44 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1008301870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8'): ({'sdl'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Removing single pathed devices sdl {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a19453-0a4a-42cc-92f6-c1e0349332b7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[97831fec-97c3-4137-8654-81d03f1096b1]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Flushing IO for device /dev/sdl {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f53fc85-e93b-44e7-8c7a-af78b6464718]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.038s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5567541f-b555-4e7e-9c79-448b77e007c8]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] SCSI volumes sdl have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a49ce73-5ff9-4c2f-9119-0c868ba4557c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d441c0f3-9e9e-4325-bd09-e0f8b35fa176]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8, portal: 172.16.0.220,3260]
Oct 18 07:12:44 user nova-compute[74587]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8, portal: 172.16.0.220,3260] successful.
Oct 18 07:12:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53ded95-5612-47e8-acd5-1f6846e7e8f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c670ab0-c19e-4d9c-b1a9-948ed23d2bdf]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] <== disconnect_volume: return (383ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:12:44 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Deleting instance files /opt/stack/data/nova/instances/c17be69f-69e9-455c-9f83-5b2851b1d646_del
Oct 18 07:12:44 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Deletion of /opt/stack/data/nova/instances/c17be69f-69e9-455c-9f83-5b2851b1d646_del complete
Oct 18 07:12:44 user nova-compute[74587]: INFO nova.compute.manager [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Took 4.41 seconds to destroy the instance on the hypervisor.
Oct 18 07:12:44 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:12:44 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:12:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-7c423674-5130-4eeb-9f8f-8dc3aed9af4e req-0e812d1e-1d1e-423d-ab2b-1586ee216d8e service nova] [instance: 205d8114-61a9-4108-9f65-042656ad2a69] Received event network-vif-deleted-0d782334-b135-4c85-94f5-45c448d3256c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-d5a2692e-c87a-4c4a-bbcb-5e8ad52a81af req-560e8a08-0b75-49f8-899e-1e608330f848 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-deleted-04ebae1c-d00a-46dd-8afa-2c8c24c04848 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:47 user nova-compute[74587]: INFO nova.compute.manager [req-d5a2692e-c87a-4c4a-bbcb-5e8ad52a81af req-560e8a08-0b75-49f8-899e-1e608330f848 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Neutron deleted interface 04ebae1c-d00a-46dd-8afa-2c8c24c04848; detaching it from the instance and deleting it from the info cache
Oct 18 07:12:47 user nova-compute[74587]: DEBUG nova.network.neutron [req-d5a2692e-c87a-4c4a-bbcb-5e8ad52a81af req-560e8a08-0b75-49f8-899e-1e608330f848 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [{"id": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "address": "fa:16:3e:56:ae:d7", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9f00-5c", "ovs_interfaceid": "0ebc9f00-5cf0-4e6d-9198-55b760fa7a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "address": "fa:16:3e:a9:3c:1b", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e6c08f-3e", "ovs_interfaceid": "74e6c08f-3e16-430b-bc6d-c2ea430c75b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f194c977-6d80-481e-aee6-31acfc3f10f8", "address": "fa:16:3e:ac:86:c3", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf194c977-6d", "ovs_interfaceid": "f194c977-6d80-481e-aee6-31acfc3f10f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "address": "fa:16:3e:1c:37:73", "network": {"id": "51ad2a20-8da1-415c-879a-259a32710c64", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556378299", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30d3ed-1d", "ovs_interfaceid": "2e30d3ed-1d43-4cc9-b452-eeb149c007a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "address": "fa:16:3e:e2:d8:95", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ceed310-b3", "ovs_interfaceid": "1ceed310-b30b-4ea9-88d7-6fb43a041bb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "address": "fa:16:3e:e1:17:0e", "network": {"id": "4c748bd0-e52b-4f8b-9312-9ebfe3e0aa65", "bridge": "br-int", "label": "tempest-device-tagging-net2-1417277780", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba117ef53fc64403ad516a9860cb28f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48ddaee-bb", "ovs_interfaceid": "b48ddaee-bb23-4b91-b54b-9c0ca783f780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:12:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-d5a2692e-c87a-4c4a-bbcb-5e8ad52a81af req-560e8a08-0b75-49f8-899e-1e608330f848 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Detach interface failed, port_id=04ebae1c-d00a-46dd-8afa-2c8c24c04848, reason: Instance c17be69f-69e9-455c-9f83-5b2851b1d646 could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:12:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:48 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:12:48 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Took 3.93 seconds to deallocate network for instance.
Oct 18 07:12:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-9a7f499b-ca4e-4ee5-83e5-9856f02c5304 req-ab0dbd83-1932-465c-a5e3-405ea587a807 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-deleted-1ceed310-b30b-4ea9-88d7-6fb43a041bb8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-9a7f499b-ca4e-4ee5-83e5-9856f02c5304 req-ab0dbd83-1932-465c-a5e3-405ea587a807 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-deleted-b48ddaee-bb23-4b91-b54b-9c0ca783f780 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-9a7f499b-ca4e-4ee5-83e5-9856f02c5304 req-ab0dbd83-1932-465c-a5e3-405ea587a807 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-deleted-f194c977-6d80-481e-aee6-31acfc3f10f8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-9a7f499b-ca4e-4ee5-83e5-9856f02c5304 req-ab0dbd83-1932-465c-a5e3-405ea587a807 service nova] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Received event network-vif-deleted-2e30d3ed-1d43-4cc9-b452-eeb149c007a7 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:51 user nova-compute[74587]: INFO nova.compute.manager [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Rescuing
Oct 18 07:12:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:12:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquired lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:12:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:12:51 user nova-compute[74587]: INFO nova.compute.manager [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] [instance: c17be69f-69e9-455c-9f83-5b2851b1d646] Took 2.89 seconds to detach 3 volumes for instance.
Oct 18 07:12:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:52 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Deleted allocations for instance c17be69f-69e9-455c-9f83-5b2851b1d646
Oct 18 07:12:52 user nova-compute[74587]: DEBUG nova.network.neutron [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updating instance_info_cache with network_info: [{"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Releasing lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c8edb7a3-17a2-438b-b000-91c42067a069 tempest-TaggedBootDevicesTest-150279486 tempest-TaggedBootDevicesTest-150279486-project-member] Lock "c17be69f-69e9-455c-9f83-5b2851b1d646" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.841s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-ed0ba51b-09ea-442d-8547-d2e1e78e7ab8 req-d4b498b8-6215-4f37-84c1-d48144819059 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-unplugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ed0ba51b-09ea-442d-8547-d2e1e78e7ab8 req-d4b498b8-6215-4f37-84c1-d48144819059 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ed0ba51b-09ea-442d-8547-d2e1e78e7ab8 req-d4b498b8-6215-4f37-84c1-d48144819059 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ed0ba51b-09ea-442d-8547-d2e1e78e7ab8 req-d4b498b8-6215-4f37-84c1-d48144819059 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-ed0ba51b-09ea-442d-8547-d2e1e78e7ab8 req-d4b498b8-6215-4f37-84c1-d48144819059 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-unplugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:52 user nova-compute[74587]: WARNING nova.compute.manager [req-ed0ba51b-09ea-442d-8547-d2e1e78e7ab8 req-d4b498b8-6215-4f37-84c1-d48144819059 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-unplugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state active and task_state rescuing.
Oct 18 07:12:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:53 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Instance destroyed successfully.
Oct 18 07:12:53 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Attempting a stable device rescue
Oct 18 07:12:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74587) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 07:12:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Instance directory exists: not creating {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 07:12:53 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Creating image(s)
Oct 18 07:12:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "/opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "/opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:53 user nova-compute[74587]: DEBUG nova.objects.instance [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'trusted_certs' on Instance uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "b44545af7e8b24dfc9fe59bb15d7e928066f5ace" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "b44545af7e8b24dfc9fe59bb15d7e928066f5ace" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace.part --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:54 user nova-compute[74587]: DEBUG nova.virt.images [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] 431bb280-919e-46f5-b60d-9d2aa0093b22 was qcow2, converting to raw {{(pid=74587) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 07:12:54 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:12:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace.part /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace.converted {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.compute.manager [req-87099c04-4f4a-411e-a91e-a52fdc1acb8b req-54f54ac0-fbbb-44c5-b1e8-bde59a69e641 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-87099c04-4f4a-411e-a91e-a52fdc1acb8b req-54f54ac0-fbbb-44c5-b1e8-bde59a69e641 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-87099c04-4f4a-411e-a91e-a52fdc1acb8b req-54f54ac0-fbbb-44c5-b1e8-bde59a69e641 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-87099c04-4f4a-411e-a91e-a52fdc1acb8b req-54f54ac0-fbbb-44c5-b1e8-bde59a69e641 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.compute.manager [req-87099c04-4f4a-411e-a91e-a52fdc1acb8b req-54f54ac0-fbbb-44c5-b1e8-bde59a69e641 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:55 user nova-compute[74587]: WARNING nova.compute.manager [req-87099c04-4f4a-411e-a91e-a52fdc1acb8b req-54f54ac0-fbbb-44c5-b1e8-bde59a69e641 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state active and task_state rescuing.
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace.part /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace.converted" returned: 0 in 0.217s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace.converted --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "b44545af7e8b24dfc9fe59bb15d7e928066f5ace" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.735s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "b44545af7e8b24dfc9fe59bb15d7e928066f5ace" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "b44545af7e8b24dfc9fe59bb15d7e928066f5ace" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace --force-share --output=json" returned: 0 in 0.205s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace,backing_fmt=raw /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace,backing_fmt=raw /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue" returned: 0 in 0.061s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "b44545af7e8b24dfc9fe59bb15d7e928066f5ace" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.objects.instance [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'migration_context' on Instance uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.objects.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Object Instance<d9651223-0963-4247-ab2b-48f42efb1dc8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Start _get_guest_xml network_info=[{"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "vif_mac": "fa:16:3e:7f:e2:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '431bb280-919e-46f5-b60d-9d2aa0093b22', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3cf09563-ec28-4024-a997-c00a980ae394', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVTGlAzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd9651223-0963-4247-ab2b-48f42efb1dc8', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba176de3-087f-4f43-bd58-b8194b58f3ef', 'serial': 'ba176de3-087f-4f43-bd58-b8194b58f3ef'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.objects.instance [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'resources' on Instance uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.objects.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Object Instance<d9651223-0963-4247-ab2b-48f42efb1dc8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.objects.instance [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'numa_topology' on Instance uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.objects.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Object Instance<d9651223-0963-4247-ab2b-48f42efb1dc8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:12:55 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:12:55 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.objects.instance [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'vcpu_model' on Instance uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.objects.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Object Instance<d9651223-0963-4247-ab2b-48f42efb1dc8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVTGlAzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:12:55 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:12:55 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:12:55 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[50feac75-1b47-4d4e-8642-5d115ff6f82a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EVTGlAzb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 18 07:12:55 user nova-compute[74587]: node.name = iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:12:55 user nova-compute[74587]: node.tpgt = -1
Oct 18 07:12:55 user nova-compute[74587]: node.startup = automatic
Oct 18 07:12:55 user nova-compute[74587]: node.leading_login = No
Oct 18 07:12:55 user nova-compute[74587]: iface.iscsi_ifacename = default
Oct 18 07:12:55 user nova-compute[74587]: iface.net_ifacename = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.ipaddress = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.prefix_len = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.hwaddress = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.transport_name = tcp
Oct 18 07:12:55 user nova-compute[74587]: iface.initiatorname = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.state = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.vlan_id = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.vlan_priority = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.vlan_state = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.iface_num = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.mtu = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.port = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.bootproto = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.subnet_mask = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.gateway = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.dhcp_alt_client_id_state = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.dhcp_alt_client_id = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.dhcp_dns = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.dhcp_learn_iqn = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.dhcp_req_vendor_id_state = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.dhcp_vendor_id_state = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.dhcp_vendor_id = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.dhcp_slp_da = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.fragmentation = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.gratuitous_arp = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.incoming_forwarding = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.tos_state = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.tos = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.ttl = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.delayed_ack = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.tcp_nagle = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.tcp_wsf_state = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.tcp_wsf = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.tcp_timer_scale = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.tcp_timestamp = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.redirect = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.def_task_mgmt_timeout = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.header_digest = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.data_digest = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.immediate_data = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.initial_r2t = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.data_seq_inorder = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.data_pdu_inorder = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.erl = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.max_receive_data_len = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.first_burst_len = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.max_outstanding_r2t = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.max_burst_len = 0
Oct 18 07:12:55 user nova-compute[74587]: iface.chap_auth = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.bidi_chap = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.strict_login_compliance = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.discovery_auth = <empty>
Oct 18 07:12:55 user nova-compute[74587]: iface.discovery_logout = <empty>
Oct 18 07:12:55 user nova-compute[74587]: node.discovery_address = <empty>
Oct 18 07:12:55 user nova-compute[74587]: node.discovery_port = 0
Oct 18 07:12:55 user nova-compute[74587]: node.discovery_type = static
Oct 18 07:12:55 user nova-compute[74587]: node.session.initial_cmdsn = 0
Oct 18 07:12:55 user nova-compute[74587]: node.session.initial_login_retry_max = 8
Oct 18 07:12:55 user nova-compute[74587]: node.session.xmit_thread_priority = -20
Oct 18 07:12:55 user nova-compute[74587]: node.session.cmds_max = 128
Oct 18 07:12:55 user nova-compute[74587]: node.session.queue_depth = 32
Oct 18 07:12:55 user nova-compute[74587]: node.session.nr_sessions = 1
Oct 18 07:12:55 user nova-compute[74587]: node.session.auth.authmethod = CHAP
Oct 18 07:12:55 user nova-compute[74587]: node.session.auth.username = EVTGlAzb
Oct 18 07:12:55 user nova-compute[74587]: node.session.auth.password = ***
Oct 18 07:12:55 user nova-compute[74587]: node.session.auth.username_in = <empty>
Oct 18 07:12:55 user nova-compute[74587]: node.session.auth.password_in = <empty>
Oct 18 07:12:55 user nova-compute[74587]: node.session.auth.chap_algs = MD5
Oct 18 07:12:55 user nova-compute[74587]: node.session.timeo.replacement_timeout = 120
Oct 18 07:12:55 user nova-compute[74587]: node.session.err_timeo.abort_timeout = 15
Oct 18 07:12:55 user nova-compute[74587]: node.session.err_timeo.lu_reset_timeout = 30
Oct 18 07:12:55 user nova-compute[74587]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 18 07:12:55 user nova-compute[74587]: node.session.err_timeo.host_reset_timeout = 60
Oct 18 07:12:55 user nova-compute[74587]: node.session.iscsi.FastAbort = Yes
Oct 18 07:12:55 user nova-compute[74587]: node.session.iscsi.InitialR2T = No
Oct 18 07:12:55 user nova-compute[74587]: node.session.iscsi.ImmediateData = Yes
Oct 18 07:12:55 user nova-compute[74587]: node.session.iscsi.FirstBurstLength = 262144
Oct 18 07:12:55 user nova-compute[74587]: node.session.iscsi.MaxBurstLength = 16776192
Oct 18 07:12:55 user nova-compute[74587]: node.session.iscsi.DefaultTime2Retain = 0
Oct 18 07:12:55 user nova-compute[74587]: node.session.iscsi.DefaultTime2Wait = 2
Oct 18 07:12:55 user nova-compute[74587]: node.session.iscsi.MaxConnections = 1
Oct 18 07:12:55 user nova-compute[74587]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 18 07:12:55 user nova-compute[74587]: node.session.iscsi.ERL = 0
Oct 18 07:12:55 user nova-compute[74587]: node.session.scan = manual
Oct 18 07:12:55 user nova-compute[74587]: node.session.reopen_max = 0
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].address = 172.16.0.220
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].port = 3260
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].startup = manual
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].tcp.window_size = 524288
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].tcp.type_of_service = 0
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].timeo.logout_timeout = 15
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].timeo.login_timeout = 15
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].timeo.auth_timeout = 45
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].timeo.noop_out_interval = 5
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].timeo.noop_out_timeout = 5
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].iscsi.HeaderDigest = None
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].iscsi.DataDigest = None
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].iscsi.IFMarker = No
Oct 18 07:12:55 user nova-compute[74587]: node.conn[0].iscsi.OFMarker = No
Oct 18 07:12:55 user nova-compute[74587]: # END RECORD
Oct 18 07:12:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c59147b-12a9-41bb-844c-8c737c45d4dd]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d622f0-6e38-4da0-a0a8-ecf410823b2a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVTGlAzb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVTGlAzb" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1800e343-551d-497a-97e0-a99a232641d0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EVTGlAzb'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4917bca0-6956-4c63-8d93-5fe40f1eb4d8]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e6b30-4fc6-4693-9be9-cfdb72f0b793]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:55 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:12:55 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:12:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.203s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] HCTL ('34', '0', '0', 0) found on session 14 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[45560f87-d9b0-4a6e-bcb9-2361107795d9]: (4, ('0 0 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:12:55 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching for a device in session 14 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVTGlAzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.230s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] <== connect_volume: return (232ms) {'type': 'block', 'scsi_wwn': '23436326333383930', 'path': '/dev/sdc'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436326333383930', 'path': '/dev/sdc'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1798708892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1798708892',id=12,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-604sfei6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:11:27Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=d9651223-0963-4247-ab2b-48f42efb1dc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "vif_mac": "fa:16:3e:7f:e2:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "vif_mac": "fa:16:3e:7f:e2:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=6776f41a-346e-45fa-a618-bc4f28583854,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6776f41a-34') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG nova.objects.instance [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'pci_devices' on Instance uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG nova.objects.base [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Object Instance<d9651223-0963-4247-ab2b-48f42efb1dc8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:12:56 user nova-compute[74587]:   <uuid>d9651223-0963-4247-ab2b-48f42efb1dc8</uuid>
Oct 18 07:12:56 user nova-compute[74587]:   <name>instance-0000000c</name>
Oct 18 07:12:56 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:12:56 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:12:56 user nova-compute[74587]:   <metadata>
Oct 18 07:12:56 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:12:56 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:12:56 user nova-compute[74587]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1798708892</nova:name>
Oct 18 07:12:56 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:12:55</nova:creationTime>
Oct 18 07:12:56 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:12:56 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:12:56 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:12:56 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:12:56 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:12:56 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:12:56 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:12:56 user nova-compute[74587]:       <nova:owner>
Oct 18 07:12:56 user nova-compute[74587]:         <nova:user uuid="e2ca09ce37384d25931eb9a658384255">tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member</nova:user>
Oct 18 07:12:56 user nova-compute[74587]:         <nova:project uuid="c002a125aec54fa388965a9f83cc1624">tempest-ServerBootFromVolumeStableRescueTest-1990729548</nova:project>
Oct 18 07:12:56 user nova-compute[74587]:       </nova:owner>
Oct 18 07:12:56 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:12:56 user nova-compute[74587]:       <nova:ports>
Oct 18 07:12:56 user nova-compute[74587]:         <nova:port uuid="6776f41a-346e-45fa-a618-bc4f28583854">
Oct 18 07:12:56 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 18 07:12:56 user nova-compute[74587]:         </nova:port>
Oct 18 07:12:56 user nova-compute[74587]:       </nova:ports>
Oct 18 07:12:56 user nova-compute[74587]:     </nova:instance>
Oct 18 07:12:56 user nova-compute[74587]:   </metadata>
Oct 18 07:12:56 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:12:56 user nova-compute[74587]:     <system>
Oct 18 07:12:56 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:12:56 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:12:56 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:12:56 user nova-compute[74587]:       <entry name="serial">d9651223-0963-4247-ab2b-48f42efb1dc8</entry>
Oct 18 07:12:56 user nova-compute[74587]:       <entry name="uuid">d9651223-0963-4247-ab2b-48f42efb1dc8</entry>
Oct 18 07:12:56 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:12:56 user nova-compute[74587]:     </system>
Oct 18 07:12:56 user nova-compute[74587]:   </sysinfo>
Oct 18 07:12:56 user nova-compute[74587]:   <os>
Oct 18 07:12:56 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:12:56 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:12:56 user nova-compute[74587]:   </os>
Oct 18 07:12:56 user nova-compute[74587]:   <features>
Oct 18 07:12:56 user nova-compute[74587]:     <acpi/>
Oct 18 07:12:56 user nova-compute[74587]:     <apic/>
Oct 18 07:12:56 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:12:56 user nova-compute[74587]:   </features>
Oct 18 07:12:56 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:12:56 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:12:56 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:12:56 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:12:56 user nova-compute[74587]:   </clock>
Oct 18 07:12:56 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:12:56 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:12:56 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:12:56 user nova-compute[74587]:   </cpu>
Oct 18 07:12:56 user nova-compute[74587]:   <devices>
Oct 18 07:12:56 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:12:56 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:12:56 user nova-compute[74587]:       <source dev="/dev/sdc"/>
Oct 18 07:12:56 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:12:56 user nova-compute[74587]:       <serial>ba176de3-087f-4f43-bd58-b8194b58f3ef</serial>
Oct 18 07:12:56 user nova-compute[74587]:     </disk>
Oct 18 07:12:56 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:12:56 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:12:56 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue"/>
Oct 18 07:12:56 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:12:56 user nova-compute[74587]:       <boot order="1"/>
Oct 18 07:12:56 user nova-compute[74587]:     </disk>
Oct 18 07:12:56 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:12:56 user nova-compute[74587]:       <mac address="fa:16:3e:7f:e2:2a"/>
Oct 18 07:12:56 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:12:56 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:12:56 user nova-compute[74587]:       <target dev="tap6776f41a-34"/>
Oct 18 07:12:56 user nova-compute[74587]:     </interface>
Oct 18 07:12:56 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:12:56 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/console.log" append="off"/>
Oct 18 07:12:56 user nova-compute[74587]:     </serial>
Oct 18 07:12:56 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:12:56 user nova-compute[74587]:     <video>
Oct 18 07:12:56 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:12:56 user nova-compute[74587]:     </video>
Oct 18 07:12:56 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:12:56 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:12:56 user nova-compute[74587]:     </rng>
Oct 18 07:12:56 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:12:56 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:12:56 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:12:56 user nova-compute[74587]:     </memballoon>
Oct 18 07:12:56 user nova-compute[74587]:   </devices>
Oct 18 07:12:56 user nova-compute[74587]: </domain>
Oct 18 07:12:56 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:12:56 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Instance destroyed successfully.
Oct 18 07:12:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:12:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No VIF found with MAC fa:16:3e:7f:e2:2a, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:12:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:57 user nova-compute[74587]: DEBUG nova.compute.manager [req-5c21bcae-c94a-4d31-8b61-6a77f1de3f6b req-43d0aecd-8764-452b-9861-a392f4598590 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5c21bcae-c94a-4d31-8b61-6a77f1de3f6b req-43d0aecd-8764-452b-9861-a392f4598590 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5c21bcae-c94a-4d31-8b61-6a77f1de3f6b req-43d0aecd-8764-452b-9861-a392f4598590 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5c21bcae-c94a-4d31-8b61-6a77f1de3f6b req-43d0aecd-8764-452b-9861-a392f4598590 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:57 user nova-compute[74587]: DEBUG nova.compute.manager [req-5c21bcae-c94a-4d31-8b61-6a77f1de3f6b req-43d0aecd-8764-452b-9861-a392f4598590 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:57 user nova-compute[74587]: WARNING nova.compute.manager [req-5c21bcae-c94a-4d31-8b61-6a77f1de3f6b req-43d0aecd-8764-452b-9861-a392f4598590 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state active and task_state rescuing.
Oct 18 07:12:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:12:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-13f81436-e305-43e3-a9f9-3fa15957ffb9 req-6b7caba4-a0d3-4dd7-84ae-efb96538fc86 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:12:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-13f81436-e305-43e3-a9f9-3fa15957ffb9 req-6b7caba4-a0d3-4dd7-84ae-efb96538fc86 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:12:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-13f81436-e305-43e3-a9f9-3fa15957ffb9 req-6b7caba4-a0d3-4dd7-84ae-efb96538fc86 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:12:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-13f81436-e305-43e3-a9f9-3fa15957ffb9 req-6b7caba4-a0d3-4dd7-84ae-efb96538fc86 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:12:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-13f81436-e305-43e3-a9f9-3fa15957ffb9 req-6b7caba4-a0d3-4dd7-84ae-efb96538fc86 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:12:59 user nova-compute[74587]: WARNING nova.compute.manager [req-13f81436-e305-43e3-a9f9-3fa15957ffb9 req-6b7caba4-a0d3-4dd7-84ae-efb96538fc86 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state active and task_state rescuing.
Oct 18 07:12:59 user nova-compute[74587]: DEBUG nova.compute.manager [None req-122066b9-d4b5-4814-90bf-c8192a4d4634 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:13:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:13:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:13:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:13:05 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:05 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:13:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:06 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:09 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:09 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:13:12 user nova-compute[74587]: INFO nova.compute.claims [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Claim successful on node user
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG nova.network.neutron [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:13:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:13:12 user nova-compute[74587]: DEBUG nova.policy [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af9278b67f224f1695c90223a4dc1181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35bbc4b5dcf34f2a8eedb939389e7234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG nova.compute.manager [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:13:13 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Creating image(s)
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "/opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "/opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "/opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk.rescue --force-share --output=json" returned: 0 in 0.271s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.223s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.228s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk 1073741824" returned: 0 in 0.069s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG nova.network.neutron [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Successfully created port: 6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Cannot resize image /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Ensure instance console log exists: /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG nova.network.neutron [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Successfully updated port: 6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquired lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG nova.network.neutron [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-1eab327d-169c-4c0d-8032-35baa5607219 req-f16176e2-2b39-4346-90db-abdce2437799 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-changed-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-1eab327d-169c-4c0d-8032-35baa5607219 req-f16176e2-2b39-4346-90db-abdce2437799 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Refreshing instance network info cache due to event network-changed-6059c685-1a4c-4810-b1ce-e215a3d5480e. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1eab327d-169c-4c0d-8032-35baa5607219 req-f16176e2-2b39-4346-90db-abdce2437799 service nova] Acquiring lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG nova.network.neutron [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:13:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.network.neutron [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating instance_info_cache with network_info: [{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:13:15 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:13:15 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7761MB free_disk=25.467391967773438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Releasing lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.manager [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Instance network_info: |[{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1eab327d-169c-4c0d-8032-35baa5607219 req-f16176e2-2b39-4346-90db-abdce2437799 service nova] Acquired lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-1eab327d-169c-4c0d-8032-35baa5607219 req-f16176e2-2b39-4346-90db-abdce2437799 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Refreshing network info cache for port 6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Start _get_guest_xml network_info=[{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:13:15 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:13:15 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2069033531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2069033531',id=14,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2OCCzPMYKDOEUcsgfvQkCHiXxHUwNUQgB8nvUOb5VxRH/UDpQql6ChMd2+OQjXVatvUxAEl3E51L40GHaC4nhOvPlFTYlcvWZMYw9OWt/SMLgdjsX02bLIWctv4g338Q==',key_name='tempest-keypair-1908131829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-rrzz9okk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=6875e226-7b26-4c33-a180-b08239799e69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.objects.instance [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'pci_devices' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:13:15 user nova-compute[74587]:   <uuid>6875e226-7b26-4c33-a180-b08239799e69</uuid>
Oct 18 07:13:15 user nova-compute[74587]:   <name>instance-0000000e</name>
Oct 18 07:13:15 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:13:15 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:13:15 user nova-compute[74587]:   <metadata>
Oct 18 07:13:15 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:13:15 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:13:15 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2069033531</nova:name>
Oct 18 07:13:15 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:13:15</nova:creationTime>
Oct 18 07:13:15 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:13:15 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:13:15 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:13:15 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:13:15 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:13:15 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:13:15 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:13:15 user nova-compute[74587]:       <nova:owner>
Oct 18 07:13:15 user nova-compute[74587]:         <nova:user uuid="af9278b67f224f1695c90223a4dc1181">tempest-AttachVolumeShelveTestJSON-1000148669-project-member</nova:user>
Oct 18 07:13:15 user nova-compute[74587]:         <nova:project uuid="35bbc4b5dcf34f2a8eedb939389e7234">tempest-AttachVolumeShelveTestJSON-1000148669</nova:project>
Oct 18 07:13:15 user nova-compute[74587]:       </nova:owner>
Oct 18 07:13:15 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:13:15 user nova-compute[74587]:       <nova:ports>
Oct 18 07:13:15 user nova-compute[74587]:         <nova:port uuid="6059c685-1a4c-4810-b1ce-e215a3d5480e">
Oct 18 07:13:15 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 07:13:15 user nova-compute[74587]:         </nova:port>
Oct 18 07:13:15 user nova-compute[74587]:       </nova:ports>
Oct 18 07:13:15 user nova-compute[74587]:     </nova:instance>
Oct 18 07:13:15 user nova-compute[74587]:   </metadata>
Oct 18 07:13:15 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:13:15 user nova-compute[74587]:     <system>
Oct 18 07:13:15 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:13:15 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:13:15 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:13:15 user nova-compute[74587]:       <entry name="serial">6875e226-7b26-4c33-a180-b08239799e69</entry>
Oct 18 07:13:15 user nova-compute[74587]:       <entry name="uuid">6875e226-7b26-4c33-a180-b08239799e69</entry>
Oct 18 07:13:15 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:13:15 user nova-compute[74587]:     </system>
Oct 18 07:13:15 user nova-compute[74587]:   </sysinfo>
Oct 18 07:13:15 user nova-compute[74587]:   <os>
Oct 18 07:13:15 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:13:15 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:13:15 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:13:15 user nova-compute[74587]:   </os>
Oct 18 07:13:15 user nova-compute[74587]:   <features>
Oct 18 07:13:15 user nova-compute[74587]:     <acpi/>
Oct 18 07:13:15 user nova-compute[74587]:     <apic/>
Oct 18 07:13:15 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:13:15 user nova-compute[74587]:   </features>
Oct 18 07:13:15 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:13:15 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:13:15 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:13:15 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:13:15 user nova-compute[74587]:   </clock>
Oct 18 07:13:15 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:13:15 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:13:15 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:13:15 user nova-compute[74587]:   </cpu>
Oct 18 07:13:15 user nova-compute[74587]:   <devices>
Oct 18 07:13:15 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:13:15 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:13:15 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk"/>
Oct 18 07:13:15 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:13:15 user nova-compute[74587]:     </disk>
Oct 18 07:13:15 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:13:15 user nova-compute[74587]:       <mac address="fa:16:3e:72:97:53"/>
Oct 18 07:13:15 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:13:15 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:13:15 user nova-compute[74587]:       <target dev="tap6059c685-1a"/>
Oct 18 07:13:15 user nova-compute[74587]:     </interface>
Oct 18 07:13:15 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:13:15 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/console.log" append="off"/>
Oct 18 07:13:15 user nova-compute[74587]:     </serial>
Oct 18 07:13:15 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:13:15 user nova-compute[74587]:     <video>
Oct 18 07:13:15 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:13:15 user nova-compute[74587]:     </video>
Oct 18 07:13:15 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:13:15 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:13:15 user nova-compute[74587]:     </rng>
Oct 18 07:13:15 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:13:15 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:13:15 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:13:15 user nova-compute[74587]:     </memballoon>
Oct 18 07:13:15 user nova-compute[74587]:   </devices>
Oct 18 07:13:15 user nova-compute[74587]: </domain>
Oct 18 07:13:15 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2069033531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2069033531',id=14,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2OCCzPMYKDOEUcsgfvQkCHiXxHUwNUQgB8nvUOb5VxRH/UDpQql6ChMd2+OQjXVatvUxAEl3E51L40GHaC4nhOvPlFTYlcvWZMYw9OWt/SMLgdjsX02bLIWctv4g338Q==',key_name='tempest-keypair-1908131829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-rrzz9okk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=6875e226-7b26-4c33-a180-b08239799e69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG os_vif [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33fcffde-1398-50ce-836c-c7c201051efe', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6059c685-1a, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6059c685-1a, col_values=(('qos', UUID('f8c480bc-d8bc-4e6e-9b27-4c597f5c9a0c')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6059c685-1a, col_values=(('external_ids', {'iface-id': '6059c685-1a4c-4810-b1ce-e215a3d5480e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:97:53', 'vm-uuid': '6875e226-7b26-4c33-a180-b08239799e69'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Applying migration context for instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b as it has an incoming, in-progress migration 701ef538-e5a8-4b17-9260-ce25d18291b4. Migration status is finished {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 18 07:13:15 user nova-compute[74587]: INFO nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating resource usage from migration 701ef538-e5a8-4b17-9260-ce25d18291b4
Oct 18 07:13:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:15 user nova-compute[74587]: INFO os_vif [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a')
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee417f6a-1100-4418-a4fe-e5f1f6062e3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Migration 701ef538-e5a8-4b17-9260-ce25d18291b4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 6875e226-7b26-4c33-a180-b08239799e69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] No VIF found with MAC fa:16:3e:72:97:53, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-1eab327d-169c-4c0d-8032-35baa5607219 req-f16176e2-2b39-4346-90db-abdce2437799 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updated VIF entry in instance network info cache for port 6059c685-1a4c-4810-b1ce-e215a3d5480e. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-1eab327d-169c-4c0d-8032-35baa5607219 req-f16176e2-2b39-4346-90db-abdce2437799 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating instance_info_cache with network_info: [{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:13:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1eab327d-169c-4c0d-8032-35baa5607219 req-f16176e2-2b39-4346-90db-abdce2437799 service nova] Releasing lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:13:16 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:13:16 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:13:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:13:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.770s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-a1b5d536-e850-47d5-9857-db17cf26be9c req-28b97747-6eed-4fd5-8ad8-285a4ba09d8e service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a1b5d536-e850-47d5-9857-db17cf26be9c req-28b97747-6eed-4fd5-8ad8-285a4ba09d8e service nova] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a1b5d536-e850-47d5-9857-db17cf26be9c req-28b97747-6eed-4fd5-8ad8-285a4ba09d8e service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a1b5d536-e850-47d5-9857-db17cf26be9c req-28b97747-6eed-4fd5-8ad8-285a4ba09d8e service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-a1b5d536-e850-47d5-9857-db17cf26be9c req-28b97747-6eed-4fd5-8ad8-285a4ba09d8e service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] No waiting events found dispatching network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:17 user nova-compute[74587]: WARNING nova.compute.manager [req-a1b5d536-e850-47d5-9857-db17cf26be9c req-28b97747-6eed-4fd5-8ad8-285a4ba09d8e service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received unexpected event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e for instance with vm_state building and task_state spawning.
Oct 18 07:13:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.compute.manager [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:13:19 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Instance spawned successfully.
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-b0b16716-9729-47e0-b189-f03afb364399 req-f5730f8a-d1f8-4fd9-8923-6676102ea114 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b0b16716-9729-47e0-b189-f03afb364399 req-f5730f8a-d1f8-4fd9-8923-6676102ea114 service nova] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b0b16716-9729-47e0-b189-f03afb364399 req-f5730f8a-d1f8-4fd9-8923-6676102ea114 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b0b16716-9729-47e0-b189-f03afb364399 req-f5730f8a-d1f8-4fd9-8923-6676102ea114 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-b0b16716-9729-47e0-b189-f03afb364399 req-f5730f8a-d1f8-4fd9-8923-6676102ea114 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] No waiting events found dispatching network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:19 user nova-compute[74587]: WARNING nova.compute.manager [req-b0b16716-9729-47e0-b189-f03afb364399 req-f5730f8a-d1f8-4fd9-8923-6676102ea114 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received unexpected event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e for instance with vm_state building and task_state spawning.
Oct 18 07:13:19 user nova-compute[74587]: INFO nova.compute.manager [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Took 6.55 seconds to spawn the instance on the hypervisor.
Oct 18 07:13:19 user nova-compute[74587]: DEBUG nova.compute.manager [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:13:19 user nova-compute[74587]: INFO nova.compute.manager [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Took 7.76 seconds to build instance.
Oct 18 07:13:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-53eead3a-7f83-4898-a2a7-a16714112f18 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.925s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 12b4c420-79fd-4f58-a422-59dc2b89731f {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid dc1910eb-a1c1-4310-ba25-42ac6e4d724b {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid ee417f6a-1100-4418-a4fe-e5f1f6062e3b {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "6875e226-7b26-4c33-a180-b08239799e69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "6875e226-7b26-4c33-a180-b08239799e69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:29 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Port 1f61b2a7-a701-4ffd-bf37-76309f8f9b5a binding to destination host user is already ACTIVE {{(pid=74587) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 18 07:13:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:13:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquired lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:13:29 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:13:29 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating instance_info_cache with network_info: [{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Releasing lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Creating tmpfile /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/tmplsmgziv_ to verify with other compute node that the instance is on the same shared storage. {{(pid=74587) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-eb8b24b2-77df-4fc7-8924-2fafd29ac8aa req-a5b67605-333f-45e8-bf1e-31a7244791b5 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-unplugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-eb8b24b2-77df-4fc7-8924-2fafd29ac8aa req-a5b67605-333f-45e8-bf1e-31a7244791b5 service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-eb8b24b2-77df-4fc7-8924-2fafd29ac8aa req-a5b67605-333f-45e8-bf1e-31a7244791b5 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-eb8b24b2-77df-4fc7-8924-2fafd29ac8aa req-a5b67605-333f-45e8-bf1e-31a7244791b5 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-eb8b24b2-77df-4fc7-8924-2fafd29ac8aa req-a5b67605-333f-45e8-bf1e-31a7244791b5 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-unplugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:30 user nova-compute[74587]: WARNING nova.compute.manager [req-eb8b24b2-77df-4fc7-8924-2fafd29ac8aa req-a5b67605-333f-45e8-bf1e-31a7244791b5 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-unplugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state resized and task_state resize_reverting.
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance destroyed successfully.
Oct 18 07:13:30 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lazy-loading 'resources' on Instance uuid dc1910eb-a1c1-4310-ba25-42ac6e4d724b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-755684932',display_name='tempest-ServerActionsTestOtherB-server-755684932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-755684932',id=4,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8stB7NcHNVX73tIwXaWmwjt5Z5Gy40wrIxjnndsSfNN8+LA5rjRswbgNHk/MPUZkNT6gLl8Vo+PjF4hhdbnZF62iCxOpmdu8UPwTjCHb48/H//aH3JFzmyPPPDesN3zA==',key_name='tempest-keypair-1877047546',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='658a7454d9f14afbb50a0588fa3da19f',ramdisk_id='',reservation_id='r-kaimmc3g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2137467099',owner_user_name='tempest-ServerActionsTestOtherB-2137467099-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc135a6446545888ff24712eefb1b3e',uuid=dc1910eb-a1c1-4310-ba25-42ac6e4d724b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converting VIF {"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG os_vif [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f61b2a7-a7, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74666cfc-e11f-4bef-8a45-45218ab73514) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:13:30 user nova-compute[74587]: INFO os_vif [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7')
Oct 18 07:13:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:13:30 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:13:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5ce12d-274a-4828-a66a-64938c86172b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:13:30 user nova-compute[74587]: No targets found.
Oct 18 07:13:30 user nova-compute[74587]: iSNS:
Oct 18 07:13:30 user nova-compute[74587]: No targets found.
Oct 18 07:13:30 user nova-compute[74587]: STATIC:
Oct 18 07:13:30 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627
Oct 18 07:13:30 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:13:30 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:13:30 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:13:30 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:13:30 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:13:30 user nova-compute[74587]: FIRMWARE:
Oct 18 07:13:30 user nova-compute[74587]: No targets found.
Oct 18 07:13:30 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:13:30 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:13:30 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0773ca-100f-4952-89b9-f79c6eb49e10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea2962e-4a0d-4799-878b-5229e52900e0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:13:31 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:13:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:13:31 user nova-compute[74587]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:13:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10087af250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90551c2-2ff4-4d81-839e-8d69c8da3927]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8779ede-a515-4aad-bd58-6e396a7f249b]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9e5e4e-2696-4b86-90ce-dde45d6731f4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bee0e4-9780-411a-b6e8-e8acdf1fe8e1]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f795499a-f39b-4028-a7eb-352e77f81d96]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7925089d-1751-4ef4-87d1-e325d77322cf]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]
Oct 18 07:13:31 user nova-compute[74587]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.
Oct 18 07:13:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[65735f45-d056-43b4-88c3-27080fc71b22]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] <== disconnect_volume: return (364ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:13:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-8cca721b-1500-4df4-9baf-9e798483dd0a req-23d471d2-dc86-4555-9182-19d5e7fc5993 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8cca721b-1500-4df4-9baf-9e798483dd0a req-23d471d2-dc86-4555-9182-19d5e7fc5993 service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8cca721b-1500-4df4-9baf-9e798483dd0a req-23d471d2-dc86-4555-9182-19d5e7fc5993 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8cca721b-1500-4df4-9baf-9e798483dd0a req-23d471d2-dc86-4555-9182-19d5e7fc5993 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-8cca721b-1500-4df4-9baf-9e798483dd0a req-23d471d2-dc86-4555-9182-19d5e7fc5993 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:32 user nova-compute[74587]: WARNING nova.compute.manager [req-8cca721b-1500-4df4-9baf-9e798483dd0a req-23d471d2-dc86-4555-9182-19d5e7fc5993 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state resized and task_state resize_reverting.
Oct 18 07:13:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lazy-loading 'migration_context' on Instance uuid dc1910eb-a1c1-4310-ba25-42ac6e4d724b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG nova.objects.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Object Instance<dc1910eb-a1c1-4310-ba25-42ac6e4d724b> lazy-loaded attributes: resources,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:13:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.481s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:33 user nova-compute[74587]: INFO nova.compute.manager [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Swapping old allocation on dict_keys(['397368dc-ec08-427c-87a9-228e852f6a40']) held by migration 701ef538-e5a8-4b17-9260-ce25d18291b4 for instance
Oct 18 07:13:33 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Overwriting current allocation {'allocations': {'397368dc-ec08-427c-87a9-228e852f6a40': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 18}}, 'project_id': '658a7454d9f14afbb50a0588fa3da19f', 'user_id': '1fc135a6446545888ff24712eefb1b3e', 'consumer_generation': 1} on consumer dc1910eb-a1c1-4310-ba25-42ac6e4d724b {{(pid=74587) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 18 07:13:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:13:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquired lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:13:33 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating instance_info_cache with network_info: [{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Releasing lock "refresh_cache-dc1910eb-a1c1-4310-ba25-42ac6e4d724b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG os_brick.utils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11c70bc-4171-4cb4-824e-74ea33a750c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac46add-e6d7-47e7-9182-14422fdbc4b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fab4977-71e0-467b-9151-99dd209043e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61997a7-3408-4822-9b54-7414ebb690db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:13:34 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:13:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ec2397-d9e5-4eb6-949e-5c25e8c9d790]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:13:34 user nova-compute[74587]: DEBUG os_brick.utils [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:13:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:45 user nova-compute[74587]: INFO nova.compute.manager [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Terminating instance
Oct 18 07:13:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-901194ef-35e8-45a0-8582-11a9a559fea5 req-0673fcff-3f70-43a4-b117-b5e9738f4f97 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Received event network-vif-unplugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-901194ef-35e8-45a0-8582-11a9a559fea5 req-0673fcff-3f70-43a4-b117-b5e9738f4f97 service nova] Acquiring lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-901194ef-35e8-45a0-8582-11a9a559fea5 req-0673fcff-3f70-43a4-b117-b5e9738f4f97 service nova] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-901194ef-35e8-45a0-8582-11a9a559fea5 req-0673fcff-3f70-43a4-b117-b5e9738f4f97 service nova] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-901194ef-35e8-45a0-8582-11a9a559fea5 req-0673fcff-3f70-43a4-b117-b5e9738f4f97 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] No waiting events found dispatching network-vif-unplugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-901194ef-35e8-45a0-8582-11a9a559fea5 req-0673fcff-3f70-43a4-b117-b5e9738f4f97 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Received event network-vif-unplugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Instance destroyed successfully.
Oct 18 07:13:46 user nova-compute[74587]: DEBUG nova.objects.instance [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lazy-loading 'resources' on Instance uuid ee417f6a-1100-4418-a4fe-e5f1f6062e3b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-144451901',display_name='tempest-VolumesAdminNegativeTest-server-144451901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-144451901',id=13,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:11:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8810ffdaefbd441db8632657ab4e9e60',ramdisk_id='',reservation_id='r-0z8tuu9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-312543909',owner_user_name='tempest-VolumesAdminNegativeTest-312543909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:11:47Z,user_data=None,user_id='a62f8993664c4570951ba81a466d61fd',uuid=ee417f6a-1100-4418-a4fe-e5f1f6062e3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "address": "fa:16:3e:91:0b:52", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e29fd8-8f", "ovs_interfaceid": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converting VIF {"id": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "address": "fa:16:3e:91:0b:52", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e29fd8-8f", "ovs_interfaceid": "04e29fd8-8f24-4fc5-9bf2-a7b8f033a947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=04e29fd8-8f24-4fc5-9bf2-a7b8f033a947,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e29fd8-8f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG os_vif [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=04e29fd8-8f24-4fc5-9bf2-a7b8f033a947,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e29fd8-8f') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04e29fd8-8f, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f3b54f5-ece3-43a3-a437-704bd9e9088c) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:46 user nova-compute[74587]: INFO os_vif [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=04e29fd8-8f24-4fc5-9bf2-a7b8f033a947,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e29fd8-8f')
Oct 18 07:13:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Deleting instance files /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b_del
Oct 18 07:13:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Deletion of /opt/stack/data/nova/instances/ee417f6a-1100-4418-a4fe-e5f1f6062e3b_del complete
Oct 18 07:13:46 user nova-compute[74587]: INFO nova.compute.manager [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Took 0.79 seconds to destroy the instance on the hypervisor.
Oct 18 07:13:46 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:13:46 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Took 0.55 seconds to deallocate network for instance.
Oct 18 07:13:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-14b0f00d-587d-4400-b30c-7c9ef4483da6 req-874d8a76-b4de-47e9-86b5-380a519e0071 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Received event network-vif-deleted-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:47 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:13:47 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:13:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:47 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Deleted allocations for instance ee417f6a-1100-4418-a4fe-e5f1f6062e3b
Oct 18 07:13:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-199d5441-ac97-41df-a585-a96f8340fdf8 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-7773bfff-7578-46b0-a75a-e46841e71aeb req-3cad0014-ba30-4d31-9958-19f1c1444293 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Received event network-vif-plugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7773bfff-7578-46b0-a75a-e46841e71aeb req-3cad0014-ba30-4d31-9958-19f1c1444293 service nova] Acquiring lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7773bfff-7578-46b0-a75a-e46841e71aeb req-3cad0014-ba30-4d31-9958-19f1c1444293 service nova] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7773bfff-7578-46b0-a75a-e46841e71aeb req-3cad0014-ba30-4d31-9958-19f1c1444293 service nova] Lock "ee417f6a-1100-4418-a4fe-e5f1f6062e3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-7773bfff-7578-46b0-a75a-e46841e71aeb req-3cad0014-ba30-4d31-9958-19f1c1444293 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] No waiting events found dispatching network-vif-plugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:48 user nova-compute[74587]: WARNING nova.compute.manager [req-7773bfff-7578-46b0-a75a-e46841e71aeb req-3cad0014-ba30-4d31-9958-19f1c1444293 service nova] [instance: ee417f6a-1100-4418-a4fe-e5f1f6062e3b] Received unexpected event network-vif-plugged-04e29fd8-8f24-4fc5-9bf2-a7b8f033a947 for instance with vm_state deleted and task_state None.
Oct 18 07:13:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:50 user nova-compute[74587]: INFO nova.compute.manager [None req-16e766d7-554e-4247-a49e-8f3f2a076f8e tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Unrescuing
Oct 18 07:13:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-16e766d7-554e-4247-a49e-8f3f2a076f8e tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:13:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-16e766d7-554e-4247-a49e-8f3f2a076f8e tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquired lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:13:50 user nova-compute[74587]: DEBUG nova.network.neutron [None req-16e766d7-554e-4247-a49e-8f3f2a076f8e tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-16e766d7-554e-4247-a49e-8f3f2a076f8e tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updating instance_info_cache with network_info: [{"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-16e766d7-554e-4247-a49e-8f3f2a076f8e tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Releasing lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG nova.objects.instance [None req-16e766d7-554e-4247-a49e-8f3f2a076f8e tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'flavor' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-78ad8107-b95b-4da8-b5be-f7c665536237 req-b2a949f4-294b-4674-84c3-faaa5ca0cb17 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-unplugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-78ad8107-b95b-4da8-b5be-f7c665536237 req-b2a949f4-294b-4674-84c3-faaa5ca0cb17 service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-78ad8107-b95b-4da8-b5be-f7c665536237 req-b2a949f4-294b-4674-84c3-faaa5ca0cb17 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-78ad8107-b95b-4da8-b5be-f7c665536237 req-b2a949f4-294b-4674-84c3-faaa5ca0cb17 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-78ad8107-b95b-4da8-b5be-f7c665536237 req-b2a949f4-294b-4674-84c3-faaa5ca0cb17 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-unplugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:51 user nova-compute[74587]: WARNING nova.compute.manager [req-78ad8107-b95b-4da8-b5be-f7c665536237 req-b2a949f4-294b-4674-84c3-faaa5ca0cb17 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-unplugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:13:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:52 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Instance destroyed successfully.
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Starting finish_revert_migration {{(pid=74587) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Start _get_guest_xml network_info=[{"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '343daeba-b482-4800-a076-a4caf8e15a25', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dc1910eb-a1c1-4310-ba25-42ac6e4d724b', 'attached_at': '2023-10-18T07:13:53.000000', 'detached_at': '', 'volume_id': '06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'serial': '06c33e07-1a17-4c2f-9a1b-d0818eb03627'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:13:53 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:13:53 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc1910eb-a1c1-4310-ba25-42ac6e4d724b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:13:53 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:13:53 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:13:53 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4245c683-de3b-4360-b193-c47161450a47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:13:53 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e96579-7783-488f-ba13-a8ef58fe6301]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627] added
Oct 18 07:13:53 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da64d9b-9da6-4e96-8ae3-e46fd630a1c3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cad58c0-2650-4403-9586-77dc41c0ff4f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycHXUMWF {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycHXUMWF" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[42182403-e35c-4431-acff-401234ed2e04]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycHXUMWF'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a426f5d6-b107-4917-976d-d17be8327b45]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f55a89-3db0-4711-aeb5-f15d86a44c46]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:13:53 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:13:53 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[11adfe52-790c-4ba6-a6a2-b563a0d17f5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]
Oct 18 07:13:53 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.
Oct 18 07:13:53 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b9c646-adf6-4ccb-8c16-bc2461ed3b6c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9f6bdd-730e-4c0f-bd05-5afb000642d1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:13:53 user nova-compute[74587]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:13:53 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:13:53 user nova-compute[74587]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:13:53 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c1ddf-5e82-4fdf-8655-1584a777ff92]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG nova.compute.manager [req-8b6a959c-93fb-467c-844c-76e5ff52e5c7 req-e75a65b6-fb65-43ad-8dbe-63863d6e74c8 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8b6a959c-93fb-467c-844c-76e5ff52e5c7 req-e75a65b6-fb65-43ad-8dbe-63863d6e74c8 service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8b6a959c-93fb-467c-844c-76e5ff52e5c7 req-e75a65b6-fb65-43ad-8dbe-63863d6e74c8 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8b6a959c-93fb-467c-844c-76e5ff52e5c7 req-e75a65b6-fb65-43ad-8dbe-63863d6e74c8 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG nova.compute.manager [req-8b6a959c-93fb-467c-844c-76e5ff52e5c7 req-e75a65b6-fb65-43ad-8dbe-63863d6e74c8 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:54 user nova-compute[74587]: WARNING nova.compute.manager [req-8b6a959c-93fb-467c-844c-76e5ff52e5c7 req-e75a65b6-fb65-43ad-8dbe-63863d6e74c8 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23661366165336330', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661366165336330', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-755684932',display_name='tempest-ServerActionsTestOtherB-server-755684932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-755684932',id=4,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8stB7NcHNVX73tIwXaWmwjt5Z5Gy40wrIxjnndsSfNN8+LA5rjRswbgNHk/MPUZkNT6gLl8Vo+PjF4hhdbnZF62iCxOpmdu8UPwTjCHb48/H//aH3JFzmyPPPDesN3zA==',key_name='tempest-keypair-1877047546',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='658a7454d9f14afbb50a0588fa3da19f',ramdisk_id='',reservation_id='r-kaimmc3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2137467099',owner_user_name='tempest-ServerActionsTestOtherB-2137467099-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:13:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc135a6446545888ff24712eefb1b3e',uuid=dc1910eb-a1c1-4310-ba25-42ac6e4d724b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converting VIF {"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:13:54 user nova-compute[74587]:   <uuid>dc1910eb-a1c1-4310-ba25-42ac6e4d724b</uuid>
Oct 18 07:13:54 user nova-compute[74587]:   <name>instance-00000004</name>
Oct 18 07:13:54 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:13:54 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:13:54 user nova-compute[74587]:   <metadata>
Oct 18 07:13:54 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:13:54 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:13:54 user nova-compute[74587]:       <nova:name>tempest-ServerActionsTestOtherB-server-755684932</nova:name>
Oct 18 07:13:54 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:13:53</nova:creationTime>
Oct 18 07:13:54 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:13:54 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:13:54 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:13:54 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:13:54 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:13:54 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:13:54 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:13:54 user nova-compute[74587]:       <nova:owner>
Oct 18 07:13:54 user nova-compute[74587]:         <nova:user uuid="1fc135a6446545888ff24712eefb1b3e">tempest-ServerActionsTestOtherB-2137467099-project-member</nova:user>
Oct 18 07:13:54 user nova-compute[74587]:         <nova:project uuid="658a7454d9f14afbb50a0588fa3da19f">tempest-ServerActionsTestOtherB-2137467099</nova:project>
Oct 18 07:13:54 user nova-compute[74587]:       </nova:owner>
Oct 18 07:13:54 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:13:54 user nova-compute[74587]:       <nova:ports>
Oct 18 07:13:54 user nova-compute[74587]:         <nova:port uuid="1f61b2a7-a701-4ffd-bf37-76309f8f9b5a">
Oct 18 07:13:54 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 07:13:54 user nova-compute[74587]:         </nova:port>
Oct 18 07:13:54 user nova-compute[74587]:       </nova:ports>
Oct 18 07:13:54 user nova-compute[74587]:     </nova:instance>
Oct 18 07:13:54 user nova-compute[74587]:   </metadata>
Oct 18 07:13:54 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:13:54 user nova-compute[74587]:     <system>
Oct 18 07:13:54 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:13:54 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:13:54 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:13:54 user nova-compute[74587]:       <entry name="serial">dc1910eb-a1c1-4310-ba25-42ac6e4d724b</entry>
Oct 18 07:13:54 user nova-compute[74587]:       <entry name="uuid">dc1910eb-a1c1-4310-ba25-42ac6e4d724b</entry>
Oct 18 07:13:54 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:13:54 user nova-compute[74587]:     </system>
Oct 18 07:13:54 user nova-compute[74587]:   </sysinfo>
Oct 18 07:13:54 user nova-compute[74587]:   <os>
Oct 18 07:13:54 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:13:54 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:13:54 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:13:54 user nova-compute[74587]:   </os>
Oct 18 07:13:54 user nova-compute[74587]:   <features>
Oct 18 07:13:54 user nova-compute[74587]:     <acpi/>
Oct 18 07:13:54 user nova-compute[74587]:     <apic/>
Oct 18 07:13:54 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:13:54 user nova-compute[74587]:   </features>
Oct 18 07:13:54 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:13:54 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:13:54 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:13:54 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:13:54 user nova-compute[74587]:   </clock>
Oct 18 07:13:54 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:13:54 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:13:54 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:13:54 user nova-compute[74587]:   </cpu>
Oct 18 07:13:54 user nova-compute[74587]:   <devices>
Oct 18 07:13:54 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:13:54 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:13:54 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk"/>
Oct 18 07:13:54 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:13:54 user nova-compute[74587]:     </disk>
Oct 18 07:13:54 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:13:54 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:13:54 user nova-compute[74587]:       <source dev="/dev/sdb"/>
Oct 18 07:13:54 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:13:54 user nova-compute[74587]:       <serial>06c33e07-1a17-4c2f-9a1b-d0818eb03627</serial>
Oct 18 07:13:54 user nova-compute[74587]:     </disk>
Oct 18 07:13:54 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:13:54 user nova-compute[74587]:       <mac address="fa:16:3e:1a:0b:de"/>
Oct 18 07:13:54 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:13:54 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:13:54 user nova-compute[74587]:       <target dev="tap1f61b2a7-a7"/>
Oct 18 07:13:54 user nova-compute[74587]:     </interface>
Oct 18 07:13:54 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:13:54 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/console.log" append="off"/>
Oct 18 07:13:54 user nova-compute[74587]:     </serial>
Oct 18 07:13:54 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:13:54 user nova-compute[74587]:     <video>
Oct 18 07:13:54 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:13:54 user nova-compute[74587]:     </video>
Oct 18 07:13:54 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:13:54 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:13:54 user nova-compute[74587]:     </rng>
Oct 18 07:13:54 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:13:54 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:13:54 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:13:54 user nova-compute[74587]:     </memballoon>
Oct 18 07:13:54 user nova-compute[74587]:   </devices>
Oct 18 07:13:54 user nova-compute[74587]: </domain>
Oct 18 07:13:54 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-755684932',display_name='tempest-ServerActionsTestOtherB-server-755684932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-755684932',id=4,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8stB7NcHNVX73tIwXaWmwjt5Z5Gy40wrIxjnndsSfNN8+LA5rjRswbgNHk/MPUZkNT6gLl8Vo+PjF4hhdbnZF62iCxOpmdu8UPwTjCHb48/H//aH3JFzmyPPPDesN3zA==',key_name='tempest-keypair-1877047546',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='658a7454d9f14afbb50a0588fa3da19f',ramdisk_id='',reservation_id='r-kaimmc3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2137467099',owner_user_name='tempest-ServerActionsTestOtherB-2137467099-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:13:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc135a6446545888ff24712eefb1b3e',uuid=dc1910eb-a1c1-4310-ba25-42ac6e4d724b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converting VIF {"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG os_vif [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6c1b0ab-7ed6-5b97-90e0-aed1c2dd7ebe', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f61b2a7-a7, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f61b2a7-a7, col_values=(('qos', UUID('1684bd82-3f28-4cca-a39b-e458e2395c27')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f61b2a7-a7, col_values=(('external_ids', {'iface-id': '1f61b2a7-a701-4ffd-bf37-76309f8f9b5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:0b:de', 'vm-uuid': 'dc1910eb-a1c1-4310-ba25-42ac6e4d724b'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:13:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:54 user nova-compute[74587]: INFO os_vif [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7')
Oct 18 07:13:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:56 user nova-compute[74587]: WARNING nova.compute.manager [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:13:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:56 user nova-compute[74587]: WARNING nova.compute.manager [req-447c3874-79e9-4dfa-b27b-86206eaa56ac req-f49f403c-0370-4073-ac30-6c3cbc16824e service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:13:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:56 user nova-compute[74587]: DEBUG nova.compute.manager [None req-16e766d7-554e-4247-a49e-8f3f2a076f8e tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:13:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:58 user nova-compute[74587]: WARNING nova.compute.manager [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state resized and task_state resize_reverting.
Oct 18 07:13:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:13:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:13:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:13:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:13:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:13:58 user nova-compute[74587]: WARNING nova.compute.manager [req-17ab27a2-9b5f-4c9a-8a8f-6d1139a42899 req-aa7bd2ca-d1ad-4950-a3b5-32713889dedd service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state resized and task_state resize_reverting.
Oct 18 07:13:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:13:59 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:13:59 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance running successfully.
Oct 18 07:13:59 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] finish_revert_migration finished successfully. {{(pid=74587) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 18 07:13:59 user nova-compute[74587]: INFO nova.compute.manager [None req-e3a7b967-9ba1-4fa0-994e-ac0882bfacb4 tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating instance to original state: 'active'
Oct 18 07:13:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:05 user nova-compute[74587]: DEBUG nova.compute.manager [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:14:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:05 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:14:05 user nova-compute[74587]: INFO nova.compute.claims [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Claim successful on node user
Oct 18 07:14:06 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG nova.network.neutron [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:14:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:14:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG nova.policy [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc3f0fa71a254ce0857d37a232390e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b181b13514ad18f0f72adafe71678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:14:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Creating image(s)
Oct 18 07:14:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.222s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.260s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk 1073741824" returned: 0 in 0.055s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.219s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Cannot resize image /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Ensure instance console log exists: /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:07 user nova-compute[74587]: DEBUG nova.network.neutron [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Successfully created port: 63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:14:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.network.neutron [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Successfully updated port: 63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquired lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.network.neutron [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-f69605ff-c2b4-4baf-8be9-57c1eef31b1d req-fccb700b-1581-4fda-baf9-81d16e87c46b service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-changed-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-f69605ff-c2b4-4baf-8be9-57c1eef31b1d req-fccb700b-1581-4fda-baf9-81d16e87c46b service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Refreshing instance network info cache due to event network-changed-63c9ec21-cedf-40fb-bb88-137fdb0ada25. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f69605ff-c2b4-4baf-8be9-57c1eef31b1d req-fccb700b-1581-4fda-baf9-81d16e87c46b service nova] Acquiring lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.network.neutron [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.network.neutron [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updating instance_info_cache with network_info: [{"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Releasing lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Instance network_info: |[{"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f69605ff-c2b4-4baf-8be9-57c1eef31b1d req-fccb700b-1581-4fda-baf9-81d16e87c46b service nova] Acquired lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.network.neutron [req-f69605ff-c2b4-4baf-8be9-57c1eef31b1d req-fccb700b-1581-4fda-baf9-81d16e87c46b service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Refreshing network info cache for port 63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Start _get_guest_xml network_info=[{"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:14:09 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:14:09 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:14:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1309022009',display_name='tempest-ServerStableDeviceRescueTest-server-1309022009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1309022009',id=15,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+HuSZvYMhTBndwoZFDitAG1bWKJbR8Y0n79KIgMy37m08QTWK7X7NI+1SBoM4Fp6cyZHsSfVTcL680PIULqCxeNPzGTuKFRiwq+1/7nMeuNZEWFCcHPbLRFiqo9+0Ing==',key_name='tempest-keypair-1438223812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a14b181b13514ad18f0f72adafe71678',ramdisk_id='',reservation_id='r-itjbrbvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1119520504',owner_user_name='tempest-ServerStableDeviceRescueTest-1119520504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc3f0fa71a254ce0857d37a232390e19',uuid=18ce6cb0-9632-4361-8d88-1b751e54ea71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Converting VIF {"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3e:e9,bridge_name='br-int',has_traffic_filtering=True,id=63c9ec21-cedf-40fb-bb88-137fdb0ada25,network=Network(ef9dccd1-142a-452d-9252-573d6561e243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63c9ec21-ce') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:14:09 user nova-compute[74587]: DEBUG nova.objects.instance [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'pci_devices' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:14:10 user nova-compute[74587]:   <uuid>18ce6cb0-9632-4361-8d88-1b751e54ea71</uuid>
Oct 18 07:14:10 user nova-compute[74587]:   <name>instance-0000000f</name>
Oct 18 07:14:10 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:14:10 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:14:10 user nova-compute[74587]:   <metadata>
Oct 18 07:14:10 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:14:10 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:14:10 user nova-compute[74587]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1309022009</nova:name>
Oct 18 07:14:10 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:14:09</nova:creationTime>
Oct 18 07:14:10 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:14:10 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:14:10 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:14:10 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:14:10 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:14:10 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:14:10 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:14:10 user nova-compute[74587]:       <nova:owner>
Oct 18 07:14:10 user nova-compute[74587]:         <nova:user uuid="cc3f0fa71a254ce0857d37a232390e19">tempest-ServerStableDeviceRescueTest-1119520504-project-member</nova:user>
Oct 18 07:14:10 user nova-compute[74587]:         <nova:project uuid="a14b181b13514ad18f0f72adafe71678">tempest-ServerStableDeviceRescueTest-1119520504</nova:project>
Oct 18 07:14:10 user nova-compute[74587]:       </nova:owner>
Oct 18 07:14:10 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:14:10 user nova-compute[74587]:       <nova:ports>
Oct 18 07:14:10 user nova-compute[74587]:         <nova:port uuid="63c9ec21-cedf-40fb-bb88-137fdb0ada25">
Oct 18 07:14:10 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:14:10 user nova-compute[74587]:         </nova:port>
Oct 18 07:14:10 user nova-compute[74587]:       </nova:ports>
Oct 18 07:14:10 user nova-compute[74587]:     </nova:instance>
Oct 18 07:14:10 user nova-compute[74587]:   </metadata>
Oct 18 07:14:10 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:14:10 user nova-compute[74587]:     <system>
Oct 18 07:14:10 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:14:10 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:14:10 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:14:10 user nova-compute[74587]:       <entry name="serial">18ce6cb0-9632-4361-8d88-1b751e54ea71</entry>
Oct 18 07:14:10 user nova-compute[74587]:       <entry name="uuid">18ce6cb0-9632-4361-8d88-1b751e54ea71</entry>
Oct 18 07:14:10 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:14:10 user nova-compute[74587]:     </system>
Oct 18 07:14:10 user nova-compute[74587]:   </sysinfo>
Oct 18 07:14:10 user nova-compute[74587]:   <os>
Oct 18 07:14:10 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:14:10 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:14:10 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:14:10 user nova-compute[74587]:   </os>
Oct 18 07:14:10 user nova-compute[74587]:   <features>
Oct 18 07:14:10 user nova-compute[74587]:     <acpi/>
Oct 18 07:14:10 user nova-compute[74587]:     <apic/>
Oct 18 07:14:10 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:14:10 user nova-compute[74587]:   </features>
Oct 18 07:14:10 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:14:10 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:14:10 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:14:10 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:14:10 user nova-compute[74587]:   </clock>
Oct 18 07:14:10 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:14:10 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:14:10 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:14:10 user nova-compute[74587]:   </cpu>
Oct 18 07:14:10 user nova-compute[74587]:   <devices>
Oct 18 07:14:10 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:14:10 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:14:10 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk"/>
Oct 18 07:14:10 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:14:10 user nova-compute[74587]:     </disk>
Oct 18 07:14:10 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:14:10 user nova-compute[74587]:       <mac address="fa:16:3e:db:3e:e9"/>
Oct 18 07:14:10 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:14:10 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:14:10 user nova-compute[74587]:       <target dev="tap63c9ec21-ce"/>
Oct 18 07:14:10 user nova-compute[74587]:     </interface>
Oct 18 07:14:10 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:14:10 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/console.log" append="off"/>
Oct 18 07:14:10 user nova-compute[74587]:     </serial>
Oct 18 07:14:10 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:14:10 user nova-compute[74587]:     <video>
Oct 18 07:14:10 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:14:10 user nova-compute[74587]:     </video>
Oct 18 07:14:10 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:14:10 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:14:10 user nova-compute[74587]:     </rng>
Oct 18 07:14:10 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:14:10 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:14:10 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:14:10 user nova-compute[74587]:     </memballoon>
Oct 18 07:14:10 user nova-compute[74587]:   </devices>
Oct 18 07:14:10 user nova-compute[74587]: </domain>
Oct 18 07:14:10 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1309022009',display_name='tempest-ServerStableDeviceRescueTest-server-1309022009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1309022009',id=15,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+HuSZvYMhTBndwoZFDitAG1bWKJbR8Y0n79KIgMy37m08QTWK7X7NI+1SBoM4Fp6cyZHsSfVTcL680PIULqCxeNPzGTuKFRiwq+1/7nMeuNZEWFCcHPbLRFiqo9+0Ing==',key_name='tempest-keypair-1438223812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a14b181b13514ad18f0f72adafe71678',ramdisk_id='',reservation_id='r-itjbrbvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1119520504',owner_user_name='tempest-ServerStableDeviceRescueTest-1119520504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc3f0fa71a254ce0857d37a232390e19',uuid=18ce6cb0-9632-4361-8d88-1b751e54ea71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Converting VIF {"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3e:e9,bridge_name='br-int',has_traffic_filtering=True,id=63c9ec21-cedf-40fb-bb88-137fdb0ada25,network=Network(ef9dccd1-142a-452d-9252-573d6561e243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63c9ec21-ce') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG os_vif [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3e:e9,bridge_name='br-int',has_traffic_filtering=True,id=63c9ec21-cedf-40fb-bb88-137fdb0ada25,network=Network(ef9dccd1-142a-452d-9252-573d6561e243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63c9ec21-ce') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59f26cab-8d3b-5d5e-b5e4-b461e979e522', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63c9ec21-ce, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63c9ec21-ce, col_values=(('qos', UUID('e574926c-dadd-4cd5-b480-55ef310b1385')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63c9ec21-ce, col_values=(('external_ids', {'iface-id': '63c9ec21-cedf-40fb-bb88-137fdb0ada25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:3e:e9', 'vm-uuid': '18ce6cb0-9632-4361-8d88-1b751e54ea71'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:10 user nova-compute[74587]: INFO os_vif [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3e:e9,bridge_name='br-int',has_traffic_filtering=True,id=63c9ec21-cedf-40fb-bb88-137fdb0ada25,network=Network(ef9dccd1-142a-452d-9252-573d6561e243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63c9ec21-ce')
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] No VIF found with MAC fa:16:3e:db:3e:e9, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Skipping network cache update for instance because it is Building. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.network.neutron [req-f69605ff-c2b4-4baf-8be9-57c1eef31b1d req-fccb700b-1581-4fda-baf9-81d16e87c46b service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updated VIF entry in instance network info cache for port 63c9ec21-cedf-40fb-bb88-137fdb0ada25. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.network.neutron [req-f69605ff-c2b4-4baf-8be9-57c1eef31b1d req-fccb700b-1581-4fda-baf9-81d16e87c46b service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updating instance_info_cache with network_info: [{"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:14:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f69605ff-c2b4-4baf-8be9-57c1eef31b1d req-fccb700b-1581-4fda-baf9-81d16e87c46b service nova] Releasing lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:14:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updating instance_info_cache with network_info: [{"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:14:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:14:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:14:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:14:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:14:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:14:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-d1baa5bc-cf14-4974-9dce-293696299daf req-1ebd36ca-5e93-4a72-b2da-f93005ecccb9 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d1baa5bc-cf14-4974-9dce-293696299daf req-1ebd36ca-5e93-4a72-b2da-f93005ecccb9 service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d1baa5bc-cf14-4974-9dce-293696299daf req-1ebd36ca-5e93-4a72-b2da-f93005ecccb9 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d1baa5bc-cf14-4974-9dce-293696299daf req-1ebd36ca-5e93-4a72-b2da-f93005ecccb9 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.032s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-d1baa5bc-cf14-4974-9dce-293696299daf req-1ebd36ca-5e93-4a72-b2da-f93005ecccb9 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:14:12 user nova-compute[74587]: WARNING nova.compute.manager [req-d1baa5bc-cf14-4974-9dce-293696299daf req-1ebd36ca-5e93-4a72-b2da-f93005ecccb9 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state building and task_state spawning.
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:14:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-d536751d-a558-4a14-a288-82a18d00f48c req-2eee9bb8-dea3-42a9-a194-969104ca8e58 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d536751d-a558-4a14-a288-82a18d00f48c req-2eee9bb8-dea3-42a9-a194-969104ca8e58 service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d536751d-a558-4a14-a288-82a18d00f48c req-2eee9bb8-dea3-42a9-a194-969104ca8e58 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d536751d-a558-4a14-a288-82a18d00f48c req-2eee9bb8-dea3-42a9-a194-969104ca8e58 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-d536751d-a558-4a14-a288-82a18d00f48c req-2eee9bb8-dea3-42a9-a194-969104ca8e58 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:14:14 user nova-compute[74587]: WARNING nova.compute.manager [req-d536751d-a558-4a14-a288-82a18d00f48c req-2eee9bb8-dea3-42a9-a194-969104ca8e58 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state building and task_state spawning.
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Instance spawned successfully.
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:14 user nova-compute[74587]: INFO nova.compute.manager [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Took 8.06 seconds to spawn the instance on the hypervisor.
Oct 18 07:14:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:14 user nova-compute[74587]: INFO nova.compute.manager [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Took 9.34 seconds to build instance.
Oct 18 07:14:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-54efc6b2-71e1-43eb-9f8b-fe689a88cff6 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.472s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:14:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:17 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:14:17 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7779MB free_disk=25.47789764404297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 6875e226-7b26-4c33-a180-b08239799e69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:14:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:14:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "773850ee-146d-4e76-9096-8dc18e03221f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "773850ee-146d-4e76-9096-8dc18e03221f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:14:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:14:26 user nova-compute[74587]: INFO nova.compute.claims [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Claim successful on node user
Oct 18 07:14:27 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:14:27 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:14:27 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG nova.policy [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b1730cd79c54e748232c046b4d3e412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196ea516329b4e479bd8f54644007c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:14:27 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Creating image(s)
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "/opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "/opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "/opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk 1073741824" returned: 0 in 0.052s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Successfully created port: ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.203s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Cannot resize image /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Ensure instance console log exists: /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:28 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Successfully updated port: ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquired lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.compute.manager [req-9d000c1f-9976-4df3-9930-7b2be220c37b req-db4a8091-a9f0-4806-bab9-7bc97a49158a service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received event network-changed-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.compute.manager [req-9d000c1f-9976-4df3-9930-7b2be220c37b req-db4a8091-a9f0-4806-bab9-7bc97a49158a service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Refreshing instance network info cache due to event network-changed-ae95937e-2772-434a-8a14-8f361e17775a. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9d000c1f-9976-4df3-9930-7b2be220c37b req-db4a8091-a9f0-4806-bab9-7bc97a49158a service nova] Acquiring lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updating instance_info_cache with network_info: [{"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Releasing lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Instance network_info: |[{"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9d000c1f-9976-4df3-9930-7b2be220c37b req-db4a8091-a9f0-4806-bab9-7bc97a49158a service nova] Acquired lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.network.neutron [req-9d000c1f-9976-4df3-9930-7b2be220c37b req-db4a8091-a9f0-4806-bab9-7bc97a49158a service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Refreshing network info cache for port ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Start _get_guest_xml network_info=[{"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:14:29 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:14:29 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1605029498',display_name='tempest-ServerActionsTestOtherA-server-1605029498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1605029498',id=16,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA52QLTWvy/v2jV8SnvcFET/QtPPTqG94sHIUJ+eIA4fj3Aw4bOkxeUXjNyfaIA0FLk6wcOPrhSmuqIwPWgig8KHxvH3mp04gQBlQsoVn3vpHBaDRDx2a25MshLKHMkpQ==',key_name='tempest-keypair-952803272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-syd5j30s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:14:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=773850ee-146d-4e76-9096-8dc18e03221f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bc:7f,bridge_name='br-int',has_traffic_filtering=True,id=ae95937e-2772-434a-8a14-8f361e17775a,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae95937e-27') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.objects.instance [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'pci_devices' on Instance uuid 773850ee-146d-4e76-9096-8dc18e03221f {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:14:29 user nova-compute[74587]:   <uuid>773850ee-146d-4e76-9096-8dc18e03221f</uuid>
Oct 18 07:14:29 user nova-compute[74587]:   <name>instance-00000010</name>
Oct 18 07:14:29 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:14:29 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:14:29 user nova-compute[74587]:   <metadata>
Oct 18 07:14:29 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:14:29 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:14:29 user nova-compute[74587]:       <nova:name>tempest-ServerActionsTestOtherA-server-1605029498</nova:name>
Oct 18 07:14:29 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:14:29</nova:creationTime>
Oct 18 07:14:29 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:14:29 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:14:29 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:14:29 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:14:29 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:14:29 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:14:29 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:14:29 user nova-compute[74587]:       <nova:owner>
Oct 18 07:14:29 user nova-compute[74587]:         <nova:user uuid="1b1730cd79c54e748232c046b4d3e412">tempest-ServerActionsTestOtherA-2039083727-project-member</nova:user>
Oct 18 07:14:29 user nova-compute[74587]:         <nova:project uuid="196ea516329b4e479bd8f54644007c57">tempest-ServerActionsTestOtherA-2039083727</nova:project>
Oct 18 07:14:29 user nova-compute[74587]:       </nova:owner>
Oct 18 07:14:29 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:14:29 user nova-compute[74587]:       <nova:ports>
Oct 18 07:14:29 user nova-compute[74587]:         <nova:port uuid="ae95937e-2772-434a-8a14-8f361e17775a">
Oct 18 07:14:29 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 07:14:29 user nova-compute[74587]:         </nova:port>
Oct 18 07:14:29 user nova-compute[74587]:       </nova:ports>
Oct 18 07:14:29 user nova-compute[74587]:     </nova:instance>
Oct 18 07:14:29 user nova-compute[74587]:   </metadata>
Oct 18 07:14:29 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:14:29 user nova-compute[74587]:     <system>
Oct 18 07:14:29 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:14:29 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:14:29 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:14:29 user nova-compute[74587]:       <entry name="serial">773850ee-146d-4e76-9096-8dc18e03221f</entry>
Oct 18 07:14:29 user nova-compute[74587]:       <entry name="uuid">773850ee-146d-4e76-9096-8dc18e03221f</entry>
Oct 18 07:14:29 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:14:29 user nova-compute[74587]:     </system>
Oct 18 07:14:29 user nova-compute[74587]:   </sysinfo>
Oct 18 07:14:29 user nova-compute[74587]:   <os>
Oct 18 07:14:29 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:14:29 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:14:29 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:14:29 user nova-compute[74587]:   </os>
Oct 18 07:14:29 user nova-compute[74587]:   <features>
Oct 18 07:14:29 user nova-compute[74587]:     <acpi/>
Oct 18 07:14:29 user nova-compute[74587]:     <apic/>
Oct 18 07:14:29 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:14:29 user nova-compute[74587]:   </features>
Oct 18 07:14:29 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:14:29 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:14:29 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:14:29 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:14:29 user nova-compute[74587]:   </clock>
Oct 18 07:14:29 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:14:29 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:14:29 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:14:29 user nova-compute[74587]:   </cpu>
Oct 18 07:14:29 user nova-compute[74587]:   <devices>
Oct 18 07:14:29 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:14:29 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:14:29 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk"/>
Oct 18 07:14:29 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:14:29 user nova-compute[74587]:     </disk>
Oct 18 07:14:29 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:14:29 user nova-compute[74587]:       <mac address="fa:16:3e:ae:bc:7f"/>
Oct 18 07:14:29 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:14:29 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:14:29 user nova-compute[74587]:       <target dev="tapae95937e-27"/>
Oct 18 07:14:29 user nova-compute[74587]:     </interface>
Oct 18 07:14:29 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:14:29 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/console.log" append="off"/>
Oct 18 07:14:29 user nova-compute[74587]:     </serial>
Oct 18 07:14:29 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:14:29 user nova-compute[74587]:     <video>
Oct 18 07:14:29 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:14:29 user nova-compute[74587]:     </video>
Oct 18 07:14:29 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:14:29 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:14:29 user nova-compute[74587]:     </rng>
Oct 18 07:14:29 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:14:29 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:14:29 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:14:29 user nova-compute[74587]:     </memballoon>
Oct 18 07:14:29 user nova-compute[74587]:   </devices>
Oct 18 07:14:29 user nova-compute[74587]: </domain>
Oct 18 07:14:29 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1605029498',display_name='tempest-ServerActionsTestOtherA-server-1605029498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1605029498',id=16,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA52QLTWvy/v2jV8SnvcFET/QtPPTqG94sHIUJ+eIA4fj3Aw4bOkxeUXjNyfaIA0FLk6wcOPrhSmuqIwPWgig8KHxvH3mp04gQBlQsoVn3vpHBaDRDx2a25MshLKHMkpQ==',key_name='tempest-keypair-952803272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-syd5j30s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:14:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=773850ee-146d-4e76-9096-8dc18e03221f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bc:7f,bridge_name='br-int',has_traffic_filtering=True,id=ae95937e-2772-434a-8a14-8f361e17775a,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae95937e-27') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG os_vif [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bc:7f,bridge_name='br-int',has_traffic_filtering=True,id=ae95937e-2772-434a-8a14-8f361e17775a,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae95937e-27') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bea69fdb-de30-5a1a-96b2-fef230b5f589', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae95937e-27, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae95937e-27, col_values=(('qos', UUID('b3e94869-8e97-4d69-bf61-1eecc4e18dcc')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae95937e-27, col_values=(('external_ids', {'iface-id': 'ae95937e-2772-434a-8a14-8f361e17775a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:bc:7f', 'vm-uuid': '773850ee-146d-4e76-9096-8dc18e03221f'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:29 user nova-compute[74587]: INFO os_vif [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bc:7f,bridge_name='br-int',has_traffic_filtering=True,id=ae95937e-2772-434a-8a14-8f361e17775a,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae95937e-27')
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No VIF found with MAC fa:16:3e:ae:bc:7f, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.network.neutron [req-9d000c1f-9976-4df3-9930-7b2be220c37b req-db4a8091-a9f0-4806-bab9-7bc97a49158a service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updated VIF entry in instance network info cache for port ae95937e-2772-434a-8a14-8f361e17775a. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG nova.network.neutron [req-9d000c1f-9976-4df3-9930-7b2be220c37b req-db4a8091-a9f0-4806-bab9-7bc97a49158a service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updating instance_info_cache with network_info: [{"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:14:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9d000c1f-9976-4df3-9930-7b2be220c37b req-db4a8091-a9f0-4806-bab9-7bc97a49158a service nova] Releasing lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:14:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-9623311c-2c8d-4cce-866d-952239f514f9 req-c6515eb9-a403-4dc4-822b-8daa8b173e2f service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received event network-vif-plugged-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9623311c-2c8d-4cce-866d-952239f514f9 req-c6515eb9-a403-4dc4-822b-8daa8b173e2f service nova] Acquiring lock "773850ee-146d-4e76-9096-8dc18e03221f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9623311c-2c8d-4cce-866d-952239f514f9 req-c6515eb9-a403-4dc4-822b-8daa8b173e2f service nova] Lock "773850ee-146d-4e76-9096-8dc18e03221f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9623311c-2c8d-4cce-866d-952239f514f9 req-c6515eb9-a403-4dc4-822b-8daa8b173e2f service nova] Lock "773850ee-146d-4e76-9096-8dc18e03221f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-9623311c-2c8d-4cce-866d-952239f514f9 req-c6515eb9-a403-4dc4-822b-8daa8b173e2f service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] No waiting events found dispatching network-vif-plugged-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:14:31 user nova-compute[74587]: WARNING nova.compute.manager [req-9623311c-2c8d-4cce-866d-952239f514f9 req-c6515eb9-a403-4dc4-822b-8daa8b173e2f service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received unexpected event network-vif-plugged-ae95937e-2772-434a-8a14-8f361e17775a for instance with vm_state building and task_state spawning.
Oct 18 07:14:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:14:33 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Instance spawned successfully.
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:14:33 user nova-compute[74587]: INFO nova.compute.manager [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Took 5.79 seconds to spawn the instance on the hypervisor.
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-7664b28e-0d0f-4c1a-a702-298ad0b2b222 req-d7a881f7-e612-4085-b1bf-30cfe47af1e9 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received event network-vif-plugged-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7664b28e-0d0f-4c1a-a702-298ad0b2b222 req-d7a881f7-e612-4085-b1bf-30cfe47af1e9 service nova] Acquiring lock "773850ee-146d-4e76-9096-8dc18e03221f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7664b28e-0d0f-4c1a-a702-298ad0b2b222 req-d7a881f7-e612-4085-b1bf-30cfe47af1e9 service nova] Lock "773850ee-146d-4e76-9096-8dc18e03221f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7664b28e-0d0f-4c1a-a702-298ad0b2b222 req-d7a881f7-e612-4085-b1bf-30cfe47af1e9 service nova] Lock "773850ee-146d-4e76-9096-8dc18e03221f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-7664b28e-0d0f-4c1a-a702-298ad0b2b222 req-d7a881f7-e612-4085-b1bf-30cfe47af1e9 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] No waiting events found dispatching network-vif-plugged-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:14:33 user nova-compute[74587]: WARNING nova.compute.manager [req-7664b28e-0d0f-4c1a-a702-298ad0b2b222 req-d7a881f7-e612-4085-b1bf-30cfe47af1e9 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received unexpected event network-vif-plugged-ae95937e-2772-434a-8a14-8f361e17775a for instance with vm_state building and task_state spawning.
Oct 18 07:14:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:33 user nova-compute[74587]: INFO nova.compute.manager [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Took 6.57 seconds to build instance.
Oct 18 07:14:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a641091a-83d0-4139-b91a-1de3e4987ba5 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "773850ee-146d-4e76-9096-8dc18e03221f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.675s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:42 user nova-compute[74587]: INFO nova.compute.manager [None req-b9787ca0-2240-4740-8768-1c7b99f61465 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Unrescuing
Oct 18 07:14:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b9787ca0-2240-4740-8768-1c7b99f61465 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:14:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b9787ca0-2240-4740-8768-1c7b99f61465 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquired lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:14:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b9787ca0-2240-4740-8768-1c7b99f61465 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b9787ca0-2240-4740-8768-1c7b99f61465 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updating instance_info_cache with network_info: [{"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b9787ca0-2240-4740-8768-1c7b99f61465 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Releasing lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b9787ca0-2240-4740-8768-1c7b99f61465 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'flavor' on Instance uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-46798882-68fa-407c-9fc6-369c1ce41dbb req-6535af92-8b8d-4d29-8c31-45f09b269bac service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-unplugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-46798882-68fa-407c-9fc6-369c1ce41dbb req-6535af92-8b8d-4d29-8c31-45f09b269bac service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-46798882-68fa-407c-9fc6-369c1ce41dbb req-6535af92-8b8d-4d29-8c31-45f09b269bac service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-46798882-68fa-407c-9fc6-369c1ce41dbb req-6535af92-8b8d-4d29-8c31-45f09b269bac service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-46798882-68fa-407c-9fc6-369c1ce41dbb req-6535af92-8b8d-4d29-8c31-45f09b269bac service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-unplugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:14:43 user nova-compute[74587]: WARNING nova.compute.manager [req-46798882-68fa-407c-9fc6-369c1ce41dbb req-6535af92-8b8d-4d29-8c31-45f09b269bac service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-unplugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:14:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:43 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Instance destroyed successfully.
Oct 18 07:14:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-0bf6bbd0-1fc9-4164-9aef-d105a84ee7ce req-c5524d5b-6935-4337-a487-19e28aeb3340 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0bf6bbd0-1fc9-4164-9aef-d105a84ee7ce req-c5524d5b-6935-4337-a487-19e28aeb3340 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0bf6bbd0-1fc9-4164-9aef-d105a84ee7ce req-c5524d5b-6935-4337-a487-19e28aeb3340 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0bf6bbd0-1fc9-4164-9aef-d105a84ee7ce req-c5524d5b-6935-4337-a487-19e28aeb3340 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-0bf6bbd0-1fc9-4164-9aef-d105a84ee7ce req-c5524d5b-6935-4337-a487-19e28aeb3340 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:14:45 user nova-compute[74587]: WARNING nova.compute.manager [req-0bf6bbd0-1fc9-4164-9aef-d105a84ee7ce req-c5524d5b-6935-4337-a487-19e28aeb3340 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:14:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:45 user nova-compute[74587]: INFO nova.compute.manager [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Terminating instance
Oct 18 07:14:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:14:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Instance destroyed successfully.
Oct 18 07:14:46 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lazy-loading 'resources' on Instance uuid 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-576936251',display_name='tempest-VolumesAdminNegativeTest-server-576936251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-576936251',id=6,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1UmAKDgrCfAHTXVQTjX+L5+Dx2ZBaevFOLDhpP5qFDVCmcP1C4HdjNsSRtlPMvhYx+cQdXJJLCNcWSf/z4PcJtFgC/gZ9aGF5CiAVZr8wuZwMKvzt+ieCGuraFvcAs8A==',key_name='tempest-keypair-1515749912',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8810ffdaefbd441db8632657ab4e9e60',ramdisk_id='',reservation_id='r-4zzlm1sw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-312543909',owner_user_name='tempest-VolumesAdminNegativeTest-312543909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a62f8993664c4570951ba81a466d61fd',uuid=3cb1d8fe-2aa4-4182-a03c-31d1baac2f51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converting VIF {"id": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "address": "fa:16:3e:40:00:0f", "network": {"id": "371959dc-1454-4f17-986c-f312497dac8c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-732052733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8810ffdaefbd441db8632657ab4e9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd128c6b4-86", "ovs_interfaceid": "d128c6b4-8685-4248-bb78-1aafbf1ac017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d128c6b4-8685-4248-bb78-1aafbf1ac017,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd128c6b4-86') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG os_vif [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d128c6b4-8685-4248-bb78-1aafbf1ac017,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd128c6b4-86') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd128c6b4-86, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdf2f3e5-7038-4bc2-a409-792c4ecbec0b) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:46 user nova-compute[74587]: INFO os_vif [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d128c6b4-8685-4248-bb78-1aafbf1ac017,network=Network(371959dc-1454-4f17-986c-f312497dac8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd128c6b4-86')
Oct 18 07:14:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Deleting instance files /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51_del
Oct 18 07:14:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Deletion of /opt/stack/data/nova/instances/3cb1d8fe-2aa4-4182-a03c-31d1baac2f51_del complete
Oct 18 07:14:46 user nova-compute[74587]: INFO nova.compute.manager [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 18 07:14:46 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:14:46 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:14:47 user nova-compute[74587]: WARNING nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:14:47 user nova-compute[74587]: WARNING nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received event network-vif-unplugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] No waiting events found dispatching network-vif-unplugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received event network-vif-unplugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received event network-vif-plugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Acquiring lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] No waiting events found dispatching network-vif-plugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:14:47 user nova-compute[74587]: WARNING nova.compute.manager [req-c27f9388-04e4-4605-9be8-2a246607d12c req-2935a6d2-8d2e-482d-a48c-1d54a9a81899 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received unexpected event network-vif-plugged-d128c6b4-8685-4248-bb78-1aafbf1ac017 for instance with vm_state active and task_state deleting.
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:14:47 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Took 0.76 seconds to deallocate network for instance.
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b9787ca0-2240-4740-8768-1c7b99f61465 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:14:47 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:14:48 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:14:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:48 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Deleted allocations for instance 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51
Oct 18 07:14:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4d5d284-4776-47f2-a73c-c650dabf3de5 tempest-VolumesAdminNegativeTest-312543909 tempest-VolumesAdminNegativeTest-312543909-project-member] Lock "3cb1d8fe-2aa4-4182-a03c-31d1baac2f51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.324s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:14:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-5e64ee13-89d6-4eaf-a2b1-f1ffa30f0b2d req-8a8c4ad4-070c-49e5-a393-28d107a1f468 service nova] [instance: 3cb1d8fe-2aa4-4182-a03c-31d1baac2f51] Received event network-vif-deleted-d128c6b4-8685-4248-bb78-1aafbf1ac017 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:14:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:14:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-8e9c2a24-82bd-492a-8f8f-d1370d5b5990 req-c8296cf3-4a0a-4f7b-bff0-cdf547dc1877 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-changed-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:15:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-8e9c2a24-82bd-492a-8f8f-d1370d5b5990 req-c8296cf3-4a0a-4f7b-bff0-cdf547dc1877 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Refreshing instance network info cache due to event network-changed-6059c685-1a4c-4810-b1ce-e215a3d5480e. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:15:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8e9c2a24-82bd-492a-8f8f-d1370d5b5990 req-c8296cf3-4a0a-4f7b-bff0-cdf547dc1877 service nova] Acquiring lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:15:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8e9c2a24-82bd-492a-8f8f-d1370d5b5990 req-c8296cf3-4a0a-4f7b-bff0-cdf547dc1877 service nova] Acquired lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:15:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-8e9c2a24-82bd-492a-8f8f-d1370d5b5990 req-c8296cf3-4a0a-4f7b-bff0-cdf547dc1877 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Refreshing network info cache for port 6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:15:03 user nova-compute[74587]: DEBUG nova.network.neutron [req-8e9c2a24-82bd-492a-8f8f-d1370d5b5990 req-c8296cf3-4a0a-4f7b-bff0-cdf547dc1877 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updated VIF entry in instance network info cache for port 6059c685-1a4c-4810-b1ce-e215a3d5480e. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:15:03 user nova-compute[74587]: DEBUG nova.network.neutron [req-8e9c2a24-82bd-492a-8f8f-d1370d5b5990 req-c8296cf3-4a0a-4f7b-bff0-cdf547dc1877 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating instance_info_cache with network_info: [{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:15:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8e9c2a24-82bd-492a-8f8f-d1370d5b5990 req-c8296cf3-4a0a-4f7b-bff0-cdf547dc1877 service nova] Releasing lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:15:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:15:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:15:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:15:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:08 user nova-compute[74587]: INFO nova.compute.manager [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Shelving
Oct 18 07:15:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-d948802a-bb6e-46a8-ada0-36d13c45c06c req-9617b3a6-7be3-4d97-8190-7c99740a3d86 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-vif-unplugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:15:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d948802a-bb6e-46a8-ada0-36d13c45c06c req-9617b3a6-7be3-4d97-8190-7c99740a3d86 service nova] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d948802a-bb6e-46a8-ada0-36d13c45c06c req-9617b3a6-7be3-4d97-8190-7c99740a3d86 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d948802a-bb6e-46a8-ada0-36d13c45c06c req-9617b3a6-7be3-4d97-8190-7c99740a3d86 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-d948802a-bb6e-46a8-ada0-36d13c45c06c req-9617b3a6-7be3-4d97-8190-7c99740a3d86 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] No waiting events found dispatching network-vif-unplugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:15:09 user nova-compute[74587]: WARNING nova.compute.manager [req-d948802a-bb6e-46a8-ada0-36d13c45c06c req-9617b3a6-7be3-4d97-8190-7c99740a3d86 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received unexpected event network-vif-unplugged-6059c685-1a4c-4810-b1ce-e215a3d5480e for instance with vm_state active and task_state shelving.
Oct 18 07:15:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Instance destroyed successfully.
Oct 18 07:15:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Beginning cold snapshot process
Oct 18 07:15:09 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:15:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk /opt/stack/data/nova/instances/snapshots/tmphkdiskj1/5cddd0631b124431ba38f0e3f7647103 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:15:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:15:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:15:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:15:10 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:15:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk /opt/stack/data/nova/instances/snapshots/tmphkdiskj1/5cddd0631b124431ba38f0e3f7647103" returned: 0 in 0.777s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Snapshot extracted, beginning image upload
Oct 18 07:15:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updating instance_info_cache with network_info: [{"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:15:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:15:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:15:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:15:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:15:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-36ed4077-5162-4310-9780-626228e32cd0 req-ee805333-81e5-4357-9c91-a40358b04000 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:15:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-36ed4077-5162-4310-9780-626228e32cd0 req-ee805333-81e5-4357-9c91-a40358b04000 service nova] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-36ed4077-5162-4310-9780-626228e32cd0 req-ee805333-81e5-4357-9c91-a40358b04000 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-36ed4077-5162-4310-9780-626228e32cd0 req-ee805333-81e5-4357-9c91-a40358b04000 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-36ed4077-5162-4310-9780-626228e32cd0 req-ee805333-81e5-4357-9c91-a40358b04000 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] No waiting events found dispatching network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:15:11 user nova-compute[74587]: WARNING nova.compute.manager [req-36ed4077-5162-4310-9780-626228e32cd0 req-ee805333-81e5-4357-9c91-a40358b04000 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received unexpected event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e for instance with vm_state active and task_state shelving_image_uploading.
Oct 18 07:15:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:15:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:13 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Snapshot image upload complete
Oct 18 07:15:13 user nova-compute[74587]: DEBUG nova.compute.manager [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:15:13 user nova-compute[74587]: INFO nova.compute.manager [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Shelve offloading
Oct 18 07:15:13 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Instance destroyed successfully.
Oct 18 07:15:13 user nova-compute[74587]: DEBUG nova.compute.manager [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquired lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG nova.network.neutron [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG nova.network.neutron [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating instance_info_cache with network_info: [{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Releasing lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Instance destroyed successfully.
Oct 18 07:15:14 user nova-compute[74587]: DEBUG nova.objects.instance [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'resources' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2069033531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2069033531',id=14,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2OCCzPMYKDOEUcsgfvQkCHiXxHUwNUQgB8nvUOb5VxRH/UDpQql6ChMd2+OQjXVatvUxAEl3E51L40GHaC4nhOvPlFTYlcvWZMYw9OWt/SMLgdjsX02bLIWctv4g338Q==',key_name='tempest-keypair-1908131829',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-rrzz9okk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member',shelved_at='2023-10-18T07:15:13.600972',shelved_host='user',shelved_image_id='6e9b51ac-6787-450d-a1b2-66b2e1d58f5b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:15:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=6875e226-7b26-4c33-a180-b08239799e69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG os_vif [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6059c685-1a, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-f287003d-1624-4176-857e-675948378c1f req-2bac6127-7206-4225-aaa0-09b8849113ad service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-changed-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-f287003d-1624-4176-857e-675948378c1f req-2bac6127-7206-4225-aaa0-09b8849113ad service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Refreshing instance network info cache due to event network-changed-6059c685-1a4c-4810-b1ce-e215a3d5480e. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f287003d-1624-4176-857e-675948378c1f req-2bac6127-7206-4225-aaa0-09b8849113ad service nova] Acquiring lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f287003d-1624-4176-857e-675948378c1f req-2bac6127-7206-4225-aaa0-09b8849113ad service nova] Acquired lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-f287003d-1624-4176-857e-675948378c1f req-2bac6127-7206-4225-aaa0-09b8849113ad service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Refreshing network info cache for port 6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8c480bc-d8bc-4e6e-9b27-4c597f5c9a0c) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:14 user nova-compute[74587]: INFO os_vif [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a')
Oct 18 07:15:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Deleting instance files /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69_del
Oct 18 07:15:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Deletion of /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69_del complete
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:15:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:14 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Deleted allocations for instance 6875e226-7b26-4c33-a180-b08239799e69
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG nova.objects.instance [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'numa_topology' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG nova.objects.base [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Object Instance<6875e226-7b26-4c33-a180-b08239799e69> lazy-loaded attributes: resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-f287003d-1624-4176-857e-675948378c1f req-2bac6127-7206-4225-aaa0-09b8849113ad service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updated VIF entry in instance network info cache for port 6059c685-1a4c-4810-b1ce-e215a3d5480e. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-f287003d-1624-4176-857e-675948378c1f req-2bac6127-7206-4225-aaa0-09b8849113ad service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating instance_info_cache with network_info: [{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6059c685-1a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f287003d-1624-4176-857e-675948378c1f req-2bac6127-7206-4225-aaa0-09b8849113ad service nova] Releasing lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-13471af4-360c-468e-a3ad-ce196e3c25b2 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.846s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:16 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:15:16 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7903MB free_disk=25.372920989990234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:15:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:15:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:15:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:15:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:15:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:15:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:15:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:15:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:15:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:15:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:50 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:15:50 user nova-compute[74587]: INFO nova.compute.claims [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Claim successful on node user
Oct 18 07:15:51 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:15:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:15:51 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG nova.policy [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96efd41052434514aea7fe47a5eb36f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dbea9d8d34471b74b5c002f5905f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:15:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Creating image(s)
Oct 18 07:15:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.212s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.244s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk 1073741824" returned: 0 in 0.049s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.208s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Successfully created port: 5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Cannot resize image /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Ensure instance console log exists: /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Successfully updated port: 5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquired lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG nova.compute.manager [req-3d0cf395-61da-4aec-89d0-b0c7e22c628f req-370e16ba-6518-4b1a-bfef-515347b475bb service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-changed-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG nova.compute.manager [req-3d0cf395-61da-4aec-89d0-b0c7e22c628f req-370e16ba-6518-4b1a-bfef-515347b475bb service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Refreshing instance network info cache due to event network-changed-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3d0cf395-61da-4aec-89d0-b0c7e22c628f req-370e16ba-6518-4b1a-bfef-515347b475bb service nova] Acquiring lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG nova.compute.manager [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:53 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:15:53 user nova-compute[74587]: INFO nova.compute.claims [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Claim successful on node user
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updating instance_info_cache with network_info: [{"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Releasing lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Instance network_info: |[{"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3d0cf395-61da-4aec-89d0-b0c7e22c628f req-370e16ba-6518-4b1a-bfef-515347b475bb service nova] Acquired lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.network.neutron [req-3d0cf395-61da-4aec-89d0-b0c7e22c628f req-370e16ba-6518-4b1a-bfef-515347b475bb service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Refreshing network info cache for port 5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Start _get_guest_xml network_info=[{"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:15:54 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:15:54 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-356048251',display_name='tempest-ServerRescueNegativeTestJSON-server-356048251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-356048251',id=17,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5wq4FSXcSbqJDyU+OCrgV4Dw18pW88quoCGsPjcRGFr/Vma5g8ZVmcXLz7dQcu8B5T0mLVa+LScc0/X9fEMYB00IwJr46Pm9jpd4R0eouPbrfgia1GPucA9GEpLtdq5Q==',key_name='tempest-keypair-2077577956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-h5kpvvnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:15:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96efd41052434514aea7fe47a5eb36f7',uuid=e82e7877-9569-4a62-9fff-48d4bcca3848,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d8:17,bridge_name='br-int',has_traffic_filtering=True,id=5a276ea0-c80e-4c21-b65f-6fa7e10c58ba,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a276ea0-c8') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.objects.instance [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'pci_devices' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:15:54 user nova-compute[74587]:   <uuid>e82e7877-9569-4a62-9fff-48d4bcca3848</uuid>
Oct 18 07:15:54 user nova-compute[74587]:   <name>instance-00000011</name>
Oct 18 07:15:54 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:15:54 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:15:54 user nova-compute[74587]:   <metadata>
Oct 18 07:15:54 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:15:54 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:15:54 user nova-compute[74587]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-356048251</nova:name>
Oct 18 07:15:54 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:15:54</nova:creationTime>
Oct 18 07:15:54 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:15:54 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:15:54 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:15:54 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:15:54 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:15:54 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:15:54 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:15:54 user nova-compute[74587]:       <nova:owner>
Oct 18 07:15:54 user nova-compute[74587]:         <nova:user uuid="96efd41052434514aea7fe47a5eb36f7">tempest-ServerRescueNegativeTestJSON-1222499333-project-member</nova:user>
Oct 18 07:15:54 user nova-compute[74587]:         <nova:project uuid="1b1dbea9d8d34471b74b5c002f5905f0">tempest-ServerRescueNegativeTestJSON-1222499333</nova:project>
Oct 18 07:15:54 user nova-compute[74587]:       </nova:owner>
Oct 18 07:15:54 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:15:54 user nova-compute[74587]:       <nova:ports>
Oct 18 07:15:54 user nova-compute[74587]:         <nova:port uuid="5a276ea0-c80e-4c21-b65f-6fa7e10c58ba">
Oct 18 07:15:54 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 18 07:15:54 user nova-compute[74587]:         </nova:port>
Oct 18 07:15:54 user nova-compute[74587]:       </nova:ports>
Oct 18 07:15:54 user nova-compute[74587]:     </nova:instance>
Oct 18 07:15:54 user nova-compute[74587]:   </metadata>
Oct 18 07:15:54 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:15:54 user nova-compute[74587]:     <system>
Oct 18 07:15:54 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:15:54 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:15:54 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:15:54 user nova-compute[74587]:       <entry name="serial">e82e7877-9569-4a62-9fff-48d4bcca3848</entry>
Oct 18 07:15:54 user nova-compute[74587]:       <entry name="uuid">e82e7877-9569-4a62-9fff-48d4bcca3848</entry>
Oct 18 07:15:54 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:15:54 user nova-compute[74587]:     </system>
Oct 18 07:15:54 user nova-compute[74587]:   </sysinfo>
Oct 18 07:15:54 user nova-compute[74587]:   <os>
Oct 18 07:15:54 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:15:54 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:15:54 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:15:54 user nova-compute[74587]:   </os>
Oct 18 07:15:54 user nova-compute[74587]:   <features>
Oct 18 07:15:54 user nova-compute[74587]:     <acpi/>
Oct 18 07:15:54 user nova-compute[74587]:     <apic/>
Oct 18 07:15:54 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:15:54 user nova-compute[74587]:   </features>
Oct 18 07:15:54 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:15:54 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:15:54 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:15:54 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:15:54 user nova-compute[74587]:   </clock>
Oct 18 07:15:54 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:15:54 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:15:54 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:15:54 user nova-compute[74587]:   </cpu>
Oct 18 07:15:54 user nova-compute[74587]:   <devices>
Oct 18 07:15:54 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:15:54 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:15:54 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk"/>
Oct 18 07:15:54 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:15:54 user nova-compute[74587]:     </disk>
Oct 18 07:15:54 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:15:54 user nova-compute[74587]:       <mac address="fa:16:3e:bd:d8:17"/>
Oct 18 07:15:54 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:15:54 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:15:54 user nova-compute[74587]:       <target dev="tap5a276ea0-c8"/>
Oct 18 07:15:54 user nova-compute[74587]:     </interface>
Oct 18 07:15:54 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:15:54 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/console.log" append="off"/>
Oct 18 07:15:54 user nova-compute[74587]:     </serial>
Oct 18 07:15:54 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:15:54 user nova-compute[74587]:     <video>
Oct 18 07:15:54 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:15:54 user nova-compute[74587]:     </video>
Oct 18 07:15:54 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:15:54 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:15:54 user nova-compute[74587]:     </rng>
Oct 18 07:15:54 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:15:54 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:15:54 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:15:54 user nova-compute[74587]:     </memballoon>
Oct 18 07:15:54 user nova-compute[74587]:   </devices>
Oct 18 07:15:54 user nova-compute[74587]: </domain>
Oct 18 07:15:54 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-356048251',display_name='tempest-ServerRescueNegativeTestJSON-server-356048251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-356048251',id=17,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5wq4FSXcSbqJDyU+OCrgV4Dw18pW88quoCGsPjcRGFr/Vma5g8ZVmcXLz7dQcu8B5T0mLVa+LScc0/X9fEMYB00IwJr46Pm9jpd4R0eouPbrfgia1GPucA9GEpLtdq5Q==',key_name='tempest-keypair-2077577956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-h5kpvvnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:15:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96efd41052434514aea7fe47a5eb36f7',uuid=e82e7877-9569-4a62-9fff-48d4bcca3848,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d8:17,bridge_name='br-int',has_traffic_filtering=True,id=5a276ea0-c80e-4c21-b65f-6fa7e10c58ba,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a276ea0-c8') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG os_vif [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d8:17,bridge_name='br-int',has_traffic_filtering=True,id=5a276ea0-c80e-4c21-b65f-6fa7e10c58ba,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a276ea0-c8') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61d17633-cb8a-59d3-8674-29db72db5990', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a276ea0-c8, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a276ea0-c8, col_values=(('qos', UUID('9adee4bb-8e0e-4694-b5db-a07365064ba2')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a276ea0-c8, col_values=(('external_ids', {'iface-id': '5a276ea0-c80e-4c21-b65f-6fa7e10c58ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:d8:17', 'vm-uuid': 'e82e7877-9569-4a62-9fff-48d4bcca3848'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:54 user nova-compute[74587]: INFO os_vif [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d8:17,bridge_name='br-int',has_traffic_filtering=True,id=5a276ea0-c80e-4c21-b65f-6fa7e10c58ba,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a276ea0-c8')
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No VIF found with MAC fa:16:3e:bd:d8:17, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.compute.manager [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.compute.manager [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.network.neutron [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:15:54 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.compute.manager [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.policy [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d37bad53eb04182bafeeca8ad5da945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc670d2091314f6489b707b188abd0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.network.neutron [req-3d0cf395-61da-4aec-89d0-b0c7e22c628f req-370e16ba-6518-4b1a-bfef-515347b475bb service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updated VIF entry in instance network info cache for port 5a276ea0-c80e-4c21-b65f-6fa7e10c58ba. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.network.neutron [req-3d0cf395-61da-4aec-89d0-b0c7e22c628f req-370e16ba-6518-4b1a-bfef-515347b475bb service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updating instance_info_cache with network_info: [{"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.compute.manager [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:15:54 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Creating image(s)
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "/opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "/opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3d0cf395-61da-4aec-89d0-b0c7e22c628f req-370e16ba-6518-4b1a-bfef-515347b475bb service nova] Releasing lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk 1073741824" returned: 0 in 0.047s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.227s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Cannot resize image /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Ensure instance console log exists: /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG nova.network.neutron [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Successfully created port: a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-2a9b2b99-bb2c-4d30-b171-f7152e9299e5 req-6114c3b3-0786-4e46-899a-d22674d93e68 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2a9b2b99-bb2c-4d30-b171-f7152e9299e5 req-6114c3b3-0786-4e46-899a-d22674d93e68 service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2a9b2b99-bb2c-4d30-b171-f7152e9299e5 req-6114c3b3-0786-4e46-899a-d22674d93e68 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2a9b2b99-bb2c-4d30-b171-f7152e9299e5 req-6114c3b3-0786-4e46-899a-d22674d93e68 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-2a9b2b99-bb2c-4d30-b171-f7152e9299e5 req-6114c3b3-0786-4e46-899a-d22674d93e68 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:15:56 user nova-compute[74587]: WARNING nova.compute.manager [req-2a9b2b99-bb2c-4d30-b171-f7152e9299e5 req-6114c3b3-0786-4e46-899a-d22674d93e68 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state building and task_state spawning.
Oct 18 07:15:56 user nova-compute[74587]: DEBUG nova.network.neutron [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Successfully updated port: a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "refresh_cache-7c0cae36-8828-4b06-aab2-29e38e6cfaf2" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquired lock "refresh_cache-7c0cae36-8828-4b06-aab2-29e38e6cfaf2" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG nova.network.neutron [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-8b5ed2e1-a7ac-4104-ad1a-fe7cb5dea20c req-5280834a-c7fc-4a51-96d6-19f88edbbcdd service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Received event network-changed-a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-8b5ed2e1-a7ac-4104-ad1a-fe7cb5dea20c req-5280834a-c7fc-4a51-96d6-19f88edbbcdd service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Refreshing instance network info cache due to event network-changed-a9391110-2f57-4403-a809-c67236563e58. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8b5ed2e1-a7ac-4104-ad1a-fe7cb5dea20c req-5280834a-c7fc-4a51-96d6-19f88edbbcdd service nova] Acquiring lock "refresh_cache-7c0cae36-8828-4b06-aab2-29e38e6cfaf2" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:15:56 user nova-compute[74587]: DEBUG nova.network.neutron [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.network.neutron [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Updating instance_info_cache with network_info: [{"id": "a9391110-2f57-4403-a809-c67236563e58", "address": "fa:16:3e:80:e6:07", "network": {"id": "43146bcf-5895-4aba-80d6-3523809c34ce", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784326051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc670d2091314f6489b707b188abd0db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9391110-2f", "ovs_interfaceid": "a9391110-2f57-4403-a809-c67236563e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Releasing lock "refresh_cache-7c0cae36-8828-4b06-aab2-29e38e6cfaf2" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Instance network_info: |[{"id": "a9391110-2f57-4403-a809-c67236563e58", "address": "fa:16:3e:80:e6:07", "network": {"id": "43146bcf-5895-4aba-80d6-3523809c34ce", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784326051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc670d2091314f6489b707b188abd0db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9391110-2f", "ovs_interfaceid": "a9391110-2f57-4403-a809-c67236563e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8b5ed2e1-a7ac-4104-ad1a-fe7cb5dea20c req-5280834a-c7fc-4a51-96d6-19f88edbbcdd service nova] Acquired lock "refresh_cache-7c0cae36-8828-4b06-aab2-29e38e6cfaf2" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.network.neutron [req-8b5ed2e1-a7ac-4104-ad1a-fe7cb5dea20c req-5280834a-c7fc-4a51-96d6-19f88edbbcdd service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Refreshing network info cache for port a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Start _get_guest_xml network_info=[{"id": "a9391110-2f57-4403-a809-c67236563e58", "address": "fa:16:3e:80:e6:07", "network": {"id": "43146bcf-5895-4aba-80d6-3523809c34ce", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784326051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc670d2091314f6489b707b188abd0db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9391110-2f", "ovs_interfaceid": "a9391110-2f57-4403-a809-c67236563e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:15:57 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:15:57 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-157737958',display_name='tempest-DeleteServersTestJSON-server-157737958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-157737958',id=18,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc670d2091314f6489b707b188abd0db',ramdisk_id='',reservation_id='r-eoxsol1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1388448115',owner_user_name='tempest-DeleteServersTestJSON-1388448115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:15:55Z,user_data=None,user_id='0d37bad53eb04182bafeeca8ad5da945',uuid=7c0cae36-8828-4b06-aab2-29e38e6cfaf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9391110-2f57-4403-a809-c67236563e58", "address": "fa:16:3e:80:e6:07", "network": {"id": "43146bcf-5895-4aba-80d6-3523809c34ce", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784326051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc670d2091314f6489b707b188abd0db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9391110-2f", "ovs_interfaceid": "a9391110-2f57-4403-a809-c67236563e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Converting VIF {"id": "a9391110-2f57-4403-a809-c67236563e58", "address": "fa:16:3e:80:e6:07", "network": {"id": "43146bcf-5895-4aba-80d6-3523809c34ce", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784326051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc670d2091314f6489b707b188abd0db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9391110-2f", "ovs_interfaceid": "a9391110-2f57-4403-a809-c67236563e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=a9391110-2f57-4403-a809-c67236563e58,network=Network(43146bcf-5895-4aba-80d6-3523809c34ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9391110-2f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.objects.instance [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c0cae36-8828-4b06-aab2-29e38e6cfaf2 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:15:57 user nova-compute[74587]:   <uuid>7c0cae36-8828-4b06-aab2-29e38e6cfaf2</uuid>
Oct 18 07:15:57 user nova-compute[74587]:   <name>instance-00000012</name>
Oct 18 07:15:57 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:15:57 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:15:57 user nova-compute[74587]:   <metadata>
Oct 18 07:15:57 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:15:57 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:15:57 user nova-compute[74587]:       <nova:name>tempest-DeleteServersTestJSON-server-157737958</nova:name>
Oct 18 07:15:57 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:15:57</nova:creationTime>
Oct 18 07:15:57 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:15:57 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:15:57 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:15:57 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:15:57 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:15:57 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:15:57 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:15:57 user nova-compute[74587]:       <nova:owner>
Oct 18 07:15:57 user nova-compute[74587]:         <nova:user uuid="0d37bad53eb04182bafeeca8ad5da945">tempest-DeleteServersTestJSON-1388448115-project-member</nova:user>
Oct 18 07:15:57 user nova-compute[74587]:         <nova:project uuid="bc670d2091314f6489b707b188abd0db">tempest-DeleteServersTestJSON-1388448115</nova:project>
Oct 18 07:15:57 user nova-compute[74587]:       </nova:owner>
Oct 18 07:15:57 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:15:57 user nova-compute[74587]:       <nova:ports>
Oct 18 07:15:57 user nova-compute[74587]:         <nova:port uuid="a9391110-2f57-4403-a809-c67236563e58">
Oct 18 07:15:57 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 18 07:15:57 user nova-compute[74587]:         </nova:port>
Oct 18 07:15:57 user nova-compute[74587]:       </nova:ports>
Oct 18 07:15:57 user nova-compute[74587]:     </nova:instance>
Oct 18 07:15:57 user nova-compute[74587]:   </metadata>
Oct 18 07:15:57 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:15:57 user nova-compute[74587]:     <system>
Oct 18 07:15:57 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:15:57 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:15:57 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:15:57 user nova-compute[74587]:       <entry name="serial">7c0cae36-8828-4b06-aab2-29e38e6cfaf2</entry>
Oct 18 07:15:57 user nova-compute[74587]:       <entry name="uuid">7c0cae36-8828-4b06-aab2-29e38e6cfaf2</entry>
Oct 18 07:15:57 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:15:57 user nova-compute[74587]:     </system>
Oct 18 07:15:57 user nova-compute[74587]:   </sysinfo>
Oct 18 07:15:57 user nova-compute[74587]:   <os>
Oct 18 07:15:57 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:15:57 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:15:57 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:15:57 user nova-compute[74587]:   </os>
Oct 18 07:15:57 user nova-compute[74587]:   <features>
Oct 18 07:15:57 user nova-compute[74587]:     <acpi/>
Oct 18 07:15:57 user nova-compute[74587]:     <apic/>
Oct 18 07:15:57 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:15:57 user nova-compute[74587]:   </features>
Oct 18 07:15:57 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:15:57 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:15:57 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:15:57 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:15:57 user nova-compute[74587]:   </clock>
Oct 18 07:15:57 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:15:57 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:15:57 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:15:57 user nova-compute[74587]:   </cpu>
Oct 18 07:15:57 user nova-compute[74587]:   <devices>
Oct 18 07:15:57 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:15:57 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:15:57 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk"/>
Oct 18 07:15:57 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:15:57 user nova-compute[74587]:     </disk>
Oct 18 07:15:57 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:15:57 user nova-compute[74587]:       <mac address="fa:16:3e:80:e6:07"/>
Oct 18 07:15:57 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:15:57 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:15:57 user nova-compute[74587]:       <target dev="tapa9391110-2f"/>
Oct 18 07:15:57 user nova-compute[74587]:     </interface>
Oct 18 07:15:57 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:15:57 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/console.log" append="off"/>
Oct 18 07:15:57 user nova-compute[74587]:     </serial>
Oct 18 07:15:57 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:15:57 user nova-compute[74587]:     <video>
Oct 18 07:15:57 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:15:57 user nova-compute[74587]:     </video>
Oct 18 07:15:57 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:15:57 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:15:57 user nova-compute[74587]:     </rng>
Oct 18 07:15:57 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:15:57 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:15:57 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:15:57 user nova-compute[74587]:     </memballoon>
Oct 18 07:15:57 user nova-compute[74587]:   </devices>
Oct 18 07:15:57 user nova-compute[74587]: </domain>
Oct 18 07:15:57 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-157737958',display_name='tempest-DeleteServersTestJSON-server-157737958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-157737958',id=18,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc670d2091314f6489b707b188abd0db',ramdisk_id='',reservation_id='r-eoxsol1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1388448115',owner_user_name='tempest-DeleteServersTestJSON-1388448115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:15:55Z,user_data=None,user_id='0d37bad53eb04182bafeeca8ad5da945',uuid=7c0cae36-8828-4b06-aab2-29e38e6cfaf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9391110-2f57-4403-a809-c67236563e58", "address": "fa:16:3e:80:e6:07", "network": {"id": "43146bcf-5895-4aba-80d6-3523809c34ce", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784326051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc670d2091314f6489b707b188abd0db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9391110-2f", "ovs_interfaceid": "a9391110-2f57-4403-a809-c67236563e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Converting VIF {"id": "a9391110-2f57-4403-a809-c67236563e58", "address": "fa:16:3e:80:e6:07", "network": {"id": "43146bcf-5895-4aba-80d6-3523809c34ce", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784326051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc670d2091314f6489b707b188abd0db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9391110-2f", "ovs_interfaceid": "a9391110-2f57-4403-a809-c67236563e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=a9391110-2f57-4403-a809-c67236563e58,network=Network(43146bcf-5895-4aba-80d6-3523809c34ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9391110-2f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG os_vif [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=a9391110-2f57-4403-a809-c67236563e58,network=Network(43146bcf-5895-4aba-80d6-3523809c34ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9391110-2f') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0271d678-c369-52b9-9d50-7b292cd8d216', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9391110-2f, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9391110-2f, col_values=(('qos', UUID('8f11774e-b9bd-4548-ba47-bdfaa14297ba')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9391110-2f, col_values=(('external_ids', {'iface-id': 'a9391110-2f57-4403-a809-c67236563e58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:e6:07', 'vm-uuid': '7c0cae36-8828-4b06-aab2-29e38e6cfaf2'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:57 user nova-compute[74587]: INFO os_vif [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=a9391110-2f57-4403-a809-c67236563e58,network=Network(43146bcf-5895-4aba-80d6-3523809c34ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9391110-2f')
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] No VIF found with MAC fa:16:3e:80:e6:07, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.network.neutron [req-8b5ed2e1-a7ac-4104-ad1a-fe7cb5dea20c req-5280834a-c7fc-4a51-96d6-19f88edbbcdd service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Updated VIF entry in instance network info cache for port a9391110-2f57-4403-a809-c67236563e58. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG nova.network.neutron [req-8b5ed2e1-a7ac-4104-ad1a-fe7cb5dea20c req-5280834a-c7fc-4a51-96d6-19f88edbbcdd service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Updating instance_info_cache with network_info: [{"id": "a9391110-2f57-4403-a809-c67236563e58", "address": "fa:16:3e:80:e6:07", "network": {"id": "43146bcf-5895-4aba-80d6-3523809c34ce", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784326051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc670d2091314f6489b707b188abd0db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9391110-2f", "ovs_interfaceid": "a9391110-2f57-4403-a809-c67236563e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:15:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8b5ed2e1-a7ac-4104-ad1a-fe7cb5dea20c req-5280834a-c7fc-4a51-96d6-19f88edbbcdd service nova] Releasing lock "refresh_cache-7c0cae36-8828-4b06-aab2-29e38e6cfaf2" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:15:58 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Instance spawned successfully.
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:15:58 user nova-compute[74587]: WARNING nova.compute.manager [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state building and task_state spawning.
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-changed-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Refreshing instance network info cache due to event network-changed-63c9ec21-cedf-40fb-bb88-137fdb0ada25. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] Acquiring lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] Acquired lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.network.neutron [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Refreshing network info cache for port 63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:15:58 user nova-compute[74587]: INFO nova.compute.manager [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Took 6.74 seconds to spawn the instance on the hypervisor.
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:15:58 user nova-compute[74587]: INFO nova.compute.manager [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] instance snapshotting
Oct 18 07:15:58 user nova-compute[74587]: INFO nova.compute.manager [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Took 7.64 seconds to build instance.
Oct 18 07:15:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de6edd86-9993-454e-8733-896d89aaad8b tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.773s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:15:58 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Beginning live snapshot process
Oct 18 07:15:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json -f qcow2 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.network.neutron [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updated VIF entry in instance network info cache for port 63c9ec21-cedf-40fb-bb88-137fdb0ada25. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG nova.network.neutron [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updating instance_info_cache with network_info: [{"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-43782811-7017-41b5-b92f-8585806237a8 req-b3987fc2-b543-4162-a8b6-86a4b0f8534c service nova] Releasing lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json -f qcow2 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.210s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkrs6eugs/53a971649e8a4a0e906f0bc0e02ad0d1.delta 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:15:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:15:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkrs6eugs/53a971649e8a4a0e906f0bc0e02ad0d1.delta 1073741824" returned: 0 in 0.080s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:15:59 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 18 07:16:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-a6d91b31-e2cc-4f3a-957f-db92e2894876 req-720a1a0a-4e91-47d0-932c-32600cc96324 service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Received event network-vif-plugged-a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:16:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a6d91b31-e2cc-4f3a-957f-db92e2894876 req-720a1a0a-4e91-47d0-932c-32600cc96324 service nova] Acquiring lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a6d91b31-e2cc-4f3a-957f-db92e2894876 req-720a1a0a-4e91-47d0-932c-32600cc96324 service nova] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a6d91b31-e2cc-4f3a-957f-db92e2894876 req-720a1a0a-4e91-47d0-932c-32600cc96324 service nova] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-a6d91b31-e2cc-4f3a-957f-db92e2894876 req-720a1a0a-4e91-47d0-932c-32600cc96324 service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] No waiting events found dispatching network-vif-plugged-a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:16:00 user nova-compute[74587]: WARNING nova.compute.manager [req-a6d91b31-e2cc-4f3a-957f-db92e2894876 req-720a1a0a-4e91-47d0-932c-32600cc96324 service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Received unexpected event network-vif-plugged-a9391110-2f57-4403-a809-c67236563e58 for instance with vm_state building and task_state spawning.
Oct 18 07:16:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:16:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:16:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 18 07:16:00 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:16:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkrs6eugs/53a971649e8a4a0e906f0bc0e02ad0d1.delta /opt/stack/data/nova/instances/snapshots/tmpkrs6eugs/53a971649e8a4a0e906f0bc0e02ad0d1 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkrs6eugs/53a971649e8a4a0e906f0bc0e02ad0d1.delta /opt/stack/data/nova/instances/snapshots/tmpkrs6eugs/53a971649e8a4a0e906f0bc0e02ad0d1" returned: 0 in 0.687s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:01 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Snapshot extracted, beginning image upload
Oct 18 07:16:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:16:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:16:01 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Instance spawned successfully.
Oct 18 07:16:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:16:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:01 user nova-compute[74587]: INFO nova.compute.manager [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Took 7.23 seconds to spawn the instance on the hypervisor.
Oct 18 07:16:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:16:02 user nova-compute[74587]: INFO nova.compute.manager [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Took 8.14 seconds to build instance.
Oct 18 07:16:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-efaf1fc2-a4fc-4564-84e7-076e1d3fbdad tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.247s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-dceaa1e0-724e-4794-8d8e-5ca601dc286b req-1a8d5311-5e71-41a3-ba53-c12147a06710 service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Received event network-vif-plugged-a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:16:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dceaa1e0-724e-4794-8d8e-5ca601dc286b req-1a8d5311-5e71-41a3-ba53-c12147a06710 service nova] Acquiring lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dceaa1e0-724e-4794-8d8e-5ca601dc286b req-1a8d5311-5e71-41a3-ba53-c12147a06710 service nova] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dceaa1e0-724e-4794-8d8e-5ca601dc286b req-1a8d5311-5e71-41a3-ba53-c12147a06710 service nova] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-dceaa1e0-724e-4794-8d8e-5ca601dc286b req-1a8d5311-5e71-41a3-ba53-c12147a06710 service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] No waiting events found dispatching network-vif-plugged-a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:16:02 user nova-compute[74587]: WARNING nova.compute.manager [req-dceaa1e0-724e-4794-8d8e-5ca601dc286b req-1a8d5311-5e71-41a3-ba53-c12147a06710 service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Received unexpected event network-vif-plugged-a9391110-2f57-4403-a809-c67236563e58 for instance with vm_state active and task_state None.
Oct 18 07:16:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:05 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Snapshot image upload complete
Oct 18 07:16:05 user nova-compute[74587]: INFO nova.compute.manager [None req-879aefc9-a753-4055-b230-bf7093cfbc33 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Took 6.64 seconds to snapshot the instance on the hypervisor.
Oct 18 07:16:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:16:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:16:09 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:16:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:16:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:16:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:16:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:16:10 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:16:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updating instance_info_cache with network_info: [{"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:16:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:16:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:16:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:16:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:12 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:16:13 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:16:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:16:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:16:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:14 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:16:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-8d3afd11-7287-4616-aa3c-da2743598733 req-d3a36848-be34-4e95-ab16-3f2c4d712371 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received event network-changed-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-8d3afd11-7287-4616-aa3c-da2743598733 req-d3a36848-be34-4e95-ab16-3f2c4d712371 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Refreshing instance network info cache due to event network-changed-ae95937e-2772-434a-8a14-8f361e17775a. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8d3afd11-7287-4616-aa3c-da2743598733 req-d3a36848-be34-4e95-ab16-3f2c4d712371 service nova] Acquiring lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8d3afd11-7287-4616-aa3c-da2743598733 req-d3a36848-be34-4e95-ab16-3f2c4d712371 service nova] Acquired lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:16:17 user nova-compute[74587]: DEBUG nova.network.neutron [req-8d3afd11-7287-4616-aa3c-da2743598733 req-d3a36848-be34-4e95-ab16-3f2c4d712371 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Refreshing network info cache for port ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:16:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:18 user nova-compute[74587]: DEBUG nova.network.neutron [req-8d3afd11-7287-4616-aa3c-da2743598733 req-d3a36848-be34-4e95-ab16-3f2c4d712371 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updated VIF entry in instance network info cache for port ae95937e-2772-434a-8a14-8f361e17775a. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:16:18 user nova-compute[74587]: DEBUG nova.network.neutron [req-8d3afd11-7287-4616-aa3c-da2743598733 req-d3a36848-be34-4e95-ab16-3f2c4d712371 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updating instance_info_cache with network_info: [{"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:16:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8d3afd11-7287-4616-aa3c-da2743598733 req-d3a36848-be34-4e95-ab16-3f2c4d712371 service nova] Releasing lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:16:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:19 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:16:19 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7815MB free_disk=25.331661224365234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance e82e7877-9569-4a62-9fff-48d4bcca3848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 7c0cae36-8828-4b06-aab2-29e38e6cfaf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:16:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:16:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:20 user nova-compute[74587]: INFO nova.compute.manager [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Terminating instance
Oct 18 07:16:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:16:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-07300522-5354-4965-9d3e-28f52118c50a req-39cbf95a-a6b4-47b4-8b7f-2daa27346a58 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-unplugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-07300522-5354-4965-9d3e-28f52118c50a req-39cbf95a-a6b4-47b4-8b7f-2daa27346a58 service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-07300522-5354-4965-9d3e-28f52118c50a req-39cbf95a-a6b4-47b4-8b7f-2daa27346a58 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-07300522-5354-4965-9d3e-28f52118c50a req-39cbf95a-a6b4-47b4-8b7f-2daa27346a58 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-07300522-5354-4965-9d3e-28f52118c50a req-39cbf95a-a6b4-47b4-8b7f-2daa27346a58 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-unplugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-07300522-5354-4965-9d3e-28f52118c50a req-39cbf95a-a6b4-47b4-8b7f-2daa27346a58 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-unplugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:21 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Instance destroyed successfully.
Oct 18 07:16:21 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lazy-loading 'resources' on Instance uuid dc1910eb-a1c1-4310-ba25-42ac6e4d724b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-755684932',display_name='tempest-ServerActionsTestOtherB-server-755684932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-755684932',id=4,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8stB7NcHNVX73tIwXaWmwjt5Z5Gy40wrIxjnndsSfNN8+LA5rjRswbgNHk/MPUZkNT6gLl8Vo+PjF4hhdbnZF62iCxOpmdu8UPwTjCHb48/H//aH3JFzmyPPPDesN3zA==',key_name='tempest-keypair-1877047546',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:13:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='658a7454d9f14afbb50a0588fa3da19f',ramdisk_id='',reservation_id='r-kaimmc3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2137467099',owner_user_name='tempest-ServerActionsTestOtherB-2137467099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:14:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fc135a6446545888ff24712eefb1b3e',uuid=dc1910eb-a1c1-4310-ba25-42ac6e4d724b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converting VIF {"id": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "address": "fa:16:3e:1a:0b:de", "network": {"id": "5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-175791086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "658a7454d9f14afbb50a0588fa3da19f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f61b2a7-a7", "ovs_interfaceid": "1f61b2a7-a701-4ffd-bf37-76309f8f9b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_vif [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f61b2a7-a7, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1684bd82-3f28-4cca-a39b-e458e2395c27) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:21 user nova-compute[74587]: INFO os_vif [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:0b:de,bridge_name='br-int',has_traffic_filtering=True,id=1f61b2a7-a701-4ffd-bf37-76309f8f9b5a,network=Network(5f22fa4e-a9c7-4b6d-8069-8374a7f9fac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f61b2a7-a7')
Oct 18 07:16:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycHXUMWF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:16:21 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e94d5d-d6a5-4e67-a36c-b98128a9c71a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:16:21 user nova-compute[74587]: No targets found.
Oct 18 07:16:21 user nova-compute[74587]: iSNS:
Oct 18 07:16:21 user nova-compute[74587]: No targets found.
Oct 18 07:16:21 user nova-compute[74587]: STATIC:
Oct 18 07:16:21 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627
Oct 18 07:16:21 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:16:21 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:16:21 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:16:21 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:16:21 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:16:21 user nova-compute[74587]: FIRMWARE:
Oct 18 07:16:21 user nova-compute[74587]: No targets found.
Oct 18 07:16:21 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:16:21 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:16:21 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aefdaf3-da7d-4471-bcd0-6df6aff790c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aab617a-c04e-4d0a-b389-5046be54a61c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:16:21 user nova-compute[74587]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:16:21 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:16:21 user nova-compute[74587]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 (non-flash)
Oct 18 07:16:21 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1022b8a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c428041-1e02-4735-9aa5-01c145450e94]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f9653c-0c1d-443d-b566-550f47bbd979]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ca2aac-bc24-40a0-8c17-523b3266d4e0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6369031f-5d6e-42cd-b64b-3f3f4edb634d]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:16:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d317984-8b5b-4f6f-bcc8-9f6e1d76210e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be9a44c-6f3a-4fd5-a946-60857e90b9f4]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260]
Oct 18 07:16:22 user nova-compute[74587]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627, portal: 172.16.0.220,3260] successful.
Oct 18 07:16:22 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c33e07-1a17-4c2f-9a1b-d0818eb03627 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c5c94e-9a8a-4bec-8dd5-7be0d80149e2]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] <== disconnect_volume: return (337ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:16:22 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Deleting instance files /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b_del
Oct 18 07:16:22 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Deletion of /opt/stack/data/nova/instances/dc1910eb-a1c1-4310-ba25-42ac6e4d724b_del complete
Oct 18 07:16:22 user nova-compute[74587]: INFO nova.compute.manager [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Took 1.39 seconds to destroy the instance on the hypervisor.
Oct 18 07:16:22 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:16:22 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:16:23 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:16:23 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Took 0.86 seconds to deallocate network for instance.
Oct 18 07:16:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-6ced2ef5-b031-4f2f-918e-e1e1db15157a req-541aac24-e169-4ff2-8690-4030517ee030 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-deleted-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:16:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-414a8813-e7a2-4509-bc6a-f85a80694b65 req-8b31feb7-04ba-4e20-b4c5-45d424d765f0 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:16:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-414a8813-e7a2-4509-bc6a-f85a80694b65 req-8b31feb7-04ba-4e20-b4c5-45d424d765f0 service nova] Acquiring lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-414a8813-e7a2-4509-bc6a-f85a80694b65 req-8b31feb7-04ba-4e20-b4c5-45d424d765f0 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-414a8813-e7a2-4509-bc6a-f85a80694b65 req-8b31feb7-04ba-4e20-b4c5-45d424d765f0 service nova] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-414a8813-e7a2-4509-bc6a-f85a80694b65 req-8b31feb7-04ba-4e20-b4c5-45d424d765f0 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] No waiting events found dispatching network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:16:23 user nova-compute[74587]: WARNING nova.compute.manager [req-414a8813-e7a2-4509-bc6a-f85a80694b65 req-8b31feb7-04ba-4e20-b4c5-45d424d765f0 service nova] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Received unexpected event network-vif-plugged-1f61b2a7-a701-4ffd-bf37-76309f8f9b5a for instance with vm_state active and task_state deleting.
Oct 18 07:16:23 user nova-compute[74587]: INFO nova.compute.manager [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] [instance: dc1910eb-a1c1-4310-ba25-42ac6e4d724b] Took 0.89 seconds to detach 1 volumes for instance.
Oct 18 07:16:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:24 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:16:24 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:16:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:24 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Deleted allocations for instance dc1910eb-a1c1-4310-ba25-42ac6e4d724b
Oct 18 07:16:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e4c8deb0-4ac1-4824-b91a-6e3b8f0e5ebc tempest-ServerActionsTestOtherB-2137467099 tempest-ServerActionsTestOtherB-2137467099-project-member] Lock "dc1910eb-a1c1-4310-ba25-42ac6e4d724b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.729s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "ee7e9ad7-fe94-4031-885c-ad134624135f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:16:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:16:34 user nova-compute[74587]: INFO nova.compute.claims [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Claim successful on node user
Oct 18 07:16:35 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG nova.network.neutron [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:16:35 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:16:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG nova.policy [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2ca09ce37384d25931eb9a658384255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c002a125aec54fa388965a9f83cc1624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:16:35 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Creating image(s)
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "/opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "/opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.190s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.233s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk 1073741824" returned: 0 in 0.056s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG nova.network.neutron [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Successfully created port: a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Cannot resize image /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Ensure instance console log exists: /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.network.neutron [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Successfully updated port: a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "refresh_cache-ee7e9ad7-fe94-4031-885c-ad134624135f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquired lock "refresh_cache-ee7e9ad7-fe94-4031-885c-ad134624135f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.network.neutron [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-d5700020-b2a7-439c-b09a-6569ac35822c req-50283b81-d72b-46dd-8cab-68d749a90c61 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Received event network-changed-a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-d5700020-b2a7-439c-b09a-6569ac35822c req-50283b81-d72b-46dd-8cab-68d749a90c61 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Refreshing instance network info cache due to event network-changed-a30d6483-8e92-4258-beab-29aa0a68844a. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d5700020-b2a7-439c-b09a-6569ac35822c req-50283b81-d72b-46dd-8cab-68d749a90c61 service nova] Acquiring lock "refresh_cache-ee7e9ad7-fe94-4031-885c-ad134624135f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.network.neutron [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.network.neutron [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Updating instance_info_cache with network_info: [{"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Releasing lock "refresh_cache-ee7e9ad7-fe94-4031-885c-ad134624135f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Instance network_info: |[{"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d5700020-b2a7-439c-b09a-6569ac35822c req-50283b81-d72b-46dd-8cab-68d749a90c61 service nova] Acquired lock "refresh_cache-ee7e9ad7-fe94-4031-885c-ad134624135f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.network.neutron [req-d5700020-b2a7-439c-b09a-6569ac35822c req-50283b81-d72b-46dd-8cab-68d749a90c61 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Refreshing network info cache for port a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Start _get_guest_xml network_info=[{"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:16:37 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:16:37 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1944472517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1944472517',id=19,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-9ncbd7j3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:16:35Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=ee7e9ad7-fe94-4031-885c-ad134624135f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:d8,bridge_name='br-int',has_traffic_filtering=True,id=a30d6483-8e92-4258-beab-29aa0a68844a,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d6483-8e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.objects.instance [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'pci_devices' on Instance uuid ee7e9ad7-fe94-4031-885c-ad134624135f {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:16:37 user nova-compute[74587]:   <uuid>ee7e9ad7-fe94-4031-885c-ad134624135f</uuid>
Oct 18 07:16:37 user nova-compute[74587]:   <name>instance-00000013</name>
Oct 18 07:16:37 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:16:37 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:16:37 user nova-compute[74587]:   <metadata>
Oct 18 07:16:37 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:16:37 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:16:37 user nova-compute[74587]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1944472517</nova:name>
Oct 18 07:16:37 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:16:37</nova:creationTime>
Oct 18 07:16:37 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:16:37 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:16:37 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:16:37 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:16:37 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:16:37 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:16:37 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:16:37 user nova-compute[74587]:       <nova:owner>
Oct 18 07:16:37 user nova-compute[74587]:         <nova:user uuid="e2ca09ce37384d25931eb9a658384255">tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member</nova:user>
Oct 18 07:16:37 user nova-compute[74587]:         <nova:project uuid="c002a125aec54fa388965a9f83cc1624">tempest-ServerBootFromVolumeStableRescueTest-1990729548</nova:project>
Oct 18 07:16:37 user nova-compute[74587]:       </nova:owner>
Oct 18 07:16:37 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:16:37 user nova-compute[74587]:       <nova:ports>
Oct 18 07:16:37 user nova-compute[74587]:         <nova:port uuid="a30d6483-8e92-4258-beab-29aa0a68844a">
Oct 18 07:16:37 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 07:16:37 user nova-compute[74587]:         </nova:port>
Oct 18 07:16:37 user nova-compute[74587]:       </nova:ports>
Oct 18 07:16:37 user nova-compute[74587]:     </nova:instance>
Oct 18 07:16:37 user nova-compute[74587]:   </metadata>
Oct 18 07:16:37 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:16:37 user nova-compute[74587]:     <system>
Oct 18 07:16:37 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:16:37 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:16:37 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:16:37 user nova-compute[74587]:       <entry name="serial">ee7e9ad7-fe94-4031-885c-ad134624135f</entry>
Oct 18 07:16:37 user nova-compute[74587]:       <entry name="uuid">ee7e9ad7-fe94-4031-885c-ad134624135f</entry>
Oct 18 07:16:37 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:16:37 user nova-compute[74587]:     </system>
Oct 18 07:16:37 user nova-compute[74587]:   </sysinfo>
Oct 18 07:16:37 user nova-compute[74587]:   <os>
Oct 18 07:16:37 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:16:37 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:16:37 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:16:37 user nova-compute[74587]:   </os>
Oct 18 07:16:37 user nova-compute[74587]:   <features>
Oct 18 07:16:37 user nova-compute[74587]:     <acpi/>
Oct 18 07:16:37 user nova-compute[74587]:     <apic/>
Oct 18 07:16:37 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:16:37 user nova-compute[74587]:   </features>
Oct 18 07:16:37 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:16:37 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:16:37 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:16:37 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:16:37 user nova-compute[74587]:   </clock>
Oct 18 07:16:37 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:16:37 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:16:37 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:16:37 user nova-compute[74587]:   </cpu>
Oct 18 07:16:37 user nova-compute[74587]:   <devices>
Oct 18 07:16:37 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:16:37 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:16:37 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk"/>
Oct 18 07:16:37 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:16:37 user nova-compute[74587]:     </disk>
Oct 18 07:16:37 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:16:37 user nova-compute[74587]:       <mac address="fa:16:3e:b0:41:d8"/>
Oct 18 07:16:37 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:16:37 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:16:37 user nova-compute[74587]:       <target dev="tapa30d6483-8e"/>
Oct 18 07:16:37 user nova-compute[74587]:     </interface>
Oct 18 07:16:37 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:16:37 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/console.log" append="off"/>
Oct 18 07:16:37 user nova-compute[74587]:     </serial>
Oct 18 07:16:37 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:16:37 user nova-compute[74587]:     <video>
Oct 18 07:16:37 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:16:37 user nova-compute[74587]:     </video>
Oct 18 07:16:37 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:16:37 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:16:37 user nova-compute[74587]:     </rng>
Oct 18 07:16:37 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:16:37 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:16:37 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:16:37 user nova-compute[74587]:     </memballoon>
Oct 18 07:16:37 user nova-compute[74587]:   </devices>
Oct 18 07:16:37 user nova-compute[74587]: </domain>
Oct 18 07:16:37 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1944472517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1944472517',id=19,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-9ncbd7j3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:16:35Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=ee7e9ad7-fe94-4031-885c-ad134624135f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:d8,bridge_name='br-int',has_traffic_filtering=True,id=a30d6483-8e92-4258-beab-29aa0a68844a,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d6483-8e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG os_vif [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:d8,bridge_name='br-int',has_traffic_filtering=True,id=a30d6483-8e92-4258-beab-29aa0a68844a,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d6483-8e') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0da5722-c231-5f3e-9d87-75eb964fbd50', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa30d6483-8e, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa30d6483-8e, col_values=(('qos', UUID('0f27d88a-0890-44c8-8ef8-8edf2837b43c')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa30d6483-8e, col_values=(('external_ids', {'iface-id': 'a30d6483-8e92-4258-beab-29aa0a68844a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:41:d8', 'vm-uuid': 'ee7e9ad7-fe94-4031-885c-ad134624135f'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:37 user nova-compute[74587]: INFO os_vif [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:d8,bridge_name='br-int',has_traffic_filtering=True,id=a30d6483-8e92-4258-beab-29aa0a68844a,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d6483-8e')
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:16:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No VIF found with MAC fa:16:3e:b0:41:d8, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:16:38 user nova-compute[74587]: DEBUG nova.network.neutron [req-d5700020-b2a7-439c-b09a-6569ac35822c req-50283b81-d72b-46dd-8cab-68d749a90c61 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Updated VIF entry in instance network info cache for port a30d6483-8e92-4258-beab-29aa0a68844a. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:16:38 user nova-compute[74587]: DEBUG nova.network.neutron [req-d5700020-b2a7-439c-b09a-6569ac35822c req-50283b81-d72b-46dd-8cab-68d749a90c61 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Updating instance_info_cache with network_info: [{"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:16:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d5700020-b2a7-439c-b09a-6569ac35822c req-50283b81-d72b-46dd-8cab-68d749a90c61 service nova] Releasing lock "refresh_cache-ee7e9ad7-fe94-4031-885c-ad134624135f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:16:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-df09fa21-b69c-47cc-992a-d5ef9c0edefb req-c6ddecd0-8a49-4d7c-bee8-f5cc5d3e1d68 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Received event network-vif-plugged-a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:16:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-df09fa21-b69c-47cc-992a-d5ef9c0edefb req-c6ddecd0-8a49-4d7c-bee8-f5cc5d3e1d68 service nova] Acquiring lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-df09fa21-b69c-47cc-992a-d5ef9c0edefb req-c6ddecd0-8a49-4d7c-bee8-f5cc5d3e1d68 service nova] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-df09fa21-b69c-47cc-992a-d5ef9c0edefb req-c6ddecd0-8a49-4d7c-bee8-f5cc5d3e1d68 service nova] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-df09fa21-b69c-47cc-992a-d5ef9c0edefb req-c6ddecd0-8a49-4d7c-bee8-f5cc5d3e1d68 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] No waiting events found dispatching network-vif-plugged-a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:16:39 user nova-compute[74587]: WARNING nova.compute.manager [req-df09fa21-b69c-47cc-992a-d5ef9c0edefb req-c6ddecd0-8a49-4d7c-bee8-f5cc5d3e1d68 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Received unexpected event network-vif-plugged-a30d6483-8e92-4258-beab-29aa0a68844a for instance with vm_state building and task_state spawning.
Oct 18 07:16:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee60c9fe-4439-4c5c-9ea2-c76dbe1e7f59 req-55b9b07d-0788-4ea0-ad88-4a35b403e146 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Received event network-vif-plugged-a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee60c9fe-4439-4c5c-9ea2-c76dbe1e7f59 req-55b9b07d-0788-4ea0-ad88-4a35b403e146 service nova] Acquiring lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee60c9fe-4439-4c5c-9ea2-c76dbe1e7f59 req-55b9b07d-0788-4ea0-ad88-4a35b403e146 service nova] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ee60c9fe-4439-4c5c-9ea2-c76dbe1e7f59 req-55b9b07d-0788-4ea0-ad88-4a35b403e146 service nova] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-ee60c9fe-4439-4c5c-9ea2-c76dbe1e7f59 req-55b9b07d-0788-4ea0-ad88-4a35b403e146 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] No waiting events found dispatching network-vif-plugged-a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:16:41 user nova-compute[74587]: WARNING nova.compute.manager [req-ee60c9fe-4439-4c5c-9ea2-c76dbe1e7f59 req-55b9b07d-0788-4ea0-ad88-4a35b403e146 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Received unexpected event network-vif-plugged-a30d6483-8e92-4258-beab-29aa0a68844a for instance with vm_state building and task_state spawning.
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:16:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Instance spawned successfully.
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:16:41 user nova-compute[74587]: INFO nova.compute.manager [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Took 6.20 seconds to spawn the instance on the hypervisor.
Oct 18 07:16:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:16:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:41 user nova-compute[74587]: INFO nova.compute.manager [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Took 7.08 seconds to build instance.
Oct 18 07:16:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9389bae3-46eb-4499-93de-61ee66647068 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.188s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:16:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:16:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:01 user nova-compute[74587]: INFO nova.compute.manager [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Unshelving
Oct 18 07:17:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:01 user nova-compute[74587]: INFO nova.virt.block_device [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Booting with volume 88a6bf44-a044-4ad4-886f-a8cad2d05f51 at /dev/vdc
Oct 18 07:17:01 user nova-compute[74587]: DEBUG os_brick.utils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a707f2d-eaa0-4a57-9190-8f1eb0568327]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f439c629-8d71-4f04-aa9f-a217544b93f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca73f3-7d74-4c1e-802e-0c8968feb8ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a3160-f888-41c1-be1f-7296001decc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:17:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:17:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:17:02 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:17:02 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c875640-166e-4a69-a21d-5336465edcfc]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:17:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:17:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:17:02 user nova-compute[74587]: DEBUG os_brick.utils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:17:02 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating existing volume attachment record: f3f305e6-4835-4ad1-9a77-f82f94afed10 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:17:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:17:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:17:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:17:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:17:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:17:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:17:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:17:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:17:12 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updating instance_info_cache with network_info: [{"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:17:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:17:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:17:12 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:17:12 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:17:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:13 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:17:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:19 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:17:19 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7810MB free_disk=25.27606201171875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance e82e7877-9569-4a62-9fff-48d4bcca3848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 7c0cae36-8828-4b06-aab2-29e38e6cfaf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee7e9ad7-fe94-4031-885c-ad134624135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 6875e226-7b26-4c33-a180-b08239799e69 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:17:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:17:20 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:17:20 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:17:20 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:17:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.402s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:20 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'pci_requests' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:17:20 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'numa_topology' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:17:20 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:17:20 user nova-compute[74587]: INFO nova.compute.claims [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Claim successful on node user
Oct 18 07:17:20 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:17:20 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:17:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:20 user nova-compute[74587]: INFO nova.network.neutron [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating port 6059c685-1a4c-4810-b1ce-e215a3d5480e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 18 07:17:21 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:17:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:17:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquired lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:17:21 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:17:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-5778c53b-f66d-4bc5-8dfc-0f9c8b57582d req-898eeca3-1d3f-43ea-b531-07ef29c00d9f service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-changed-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:17:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-5778c53b-f66d-4bc5-8dfc-0f9c8b57582d req-898eeca3-1d3f-43ea-b531-07ef29c00d9f service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Refreshing instance network info cache due to event network-changed-6059c685-1a4c-4810-b1ce-e215a3d5480e. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:17:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5778c53b-f66d-4bc5-8dfc-0f9c8b57582d req-898eeca3-1d3f-43ea-b531-07ef29c00d9f service nova] Acquiring lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating instance_info_cache with network_info: [{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Releasing lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:17:22 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Creating image(s)
Oct 18 07:17:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "/opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "/opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "/opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5778c53b-f66d-4bc5-8dfc-0f9c8b57582d req-898eeca3-1d3f-43ea-b531-07ef29c00d9f service nova] Acquired lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG nova.network.neutron [req-5778c53b-f66d-4bc5-8dfc-0f9c8b57582d req-898eeca3-1d3f-43ea-b531-07ef29c00d9f service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Refreshing network info cache for port 6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG nova.objects.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Object Instance<6875e226-7b26-4c33-a180-b08239799e69> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "c4bfec5f2ca38d03b5a655bb9d000d1df4968cee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "c4bfec5f2ca38d03b5a655bb9d000d1df4968cee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee.part --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG nova.virt.images [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] 6e9b51ac-6787-450d-a1b2-66b2e1d58f5b was qcow2, converting to raw {{(pid=74587) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee.part /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee.converted {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG nova.network.neutron [req-5778c53b-f66d-4bc5-8dfc-0f9c8b57582d req-898eeca3-1d3f-43ea-b531-07ef29c00d9f service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updated VIF entry in instance network info cache for port 6059c685-1a4c-4810-b1ce-e215a3d5480e. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG nova.network.neutron [req-5778c53b-f66d-4bc5-8dfc-0f9c8b57582d req-898eeca3-1d3f-43ea-b531-07ef29c00d9f service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating instance_info_cache with network_info: [{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee.part /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee.converted" returned: 0 in 0.233s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee.converted --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5778c53b-f66d-4bc5-8dfc-0f9c8b57582d req-898eeca3-1d3f-43ea-b531-07ef29c00d9f service nova] Releasing lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee.converted --force-share --output=json" returned: 0 in 0.238s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "c4bfec5f2ca38d03b5a655bb9d000d1df4968cee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.615s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee --force-share --output=json" returned: 0 in 0.212s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "c4bfec5f2ca38d03b5a655bb9d000d1df4968cee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "c4bfec5f2ca38d03b5a655bb9d000d1df4968cee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee,backing_fmt=raw /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee,backing_fmt=raw /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk 1073741824" returned: 0 in 0.049s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "c4bfec5f2ca38d03b5a655bb9d000d1df4968cee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:24 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'migration_context' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:17:24 user nova-compute[74587]: DEBUG nova.objects.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Object Instance<6875e226-7b26-4c33-a180-b08239799e69> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:17:24 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Rebasing disk image.
Oct 18 07:17:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 -F raw /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 -F raw /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk" returned: 0 in 2.547s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Ensure instance console log exists: /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Start _get_guest_xml network_info=[{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='4c3a1e47a8c7a3ec740c509a719d2639',container_format='bare',created_at=2023-10-18T07:15:09Z,direct_url=<?>,disk_format='qcow2',id=6e9b51ac-6787-450d-a1b2-66b2e1d58f5b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2069033531-shelved',owner='35bbc4b5dcf34f2a8eedb939389e7234',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T07:15:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f3f305e6-4835-4ad1-9a77-f82f94afed10', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVRaBhHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6875e226-7b26-4c33-a180-b08239799e69', 'attached_at': '', 'detached_at': '', 'volume_id': '88a6bf44-a044-4ad4-886f-a8cad2d05f51', 'serial': '88a6bf44-a044-4ad4-886f-a8cad2d05f51'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:17:27 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:17:27 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4c3a1e47a8c7a3ec740c509a719d2639',container_format='bare',created_at=2023-10-18T07:15:09Z,direct_url=<?>,disk_format='qcow2',id=6e9b51ac-6787-450d-a1b2-66b2e1d58f5b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2069033531-shelved',owner='35bbc4b5dcf34f2a8eedb939389e7234',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T07:15:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.objects.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Object Instance<6875e226-7b26-4c33-a180-b08239799e69> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVRaBhHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:17:27 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:17:27 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:17:27 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b93dad-cc66-4c33-8ae8-45f30ff953e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:17:27 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b231f324-86af-4320-89f9-07d2fc67f4c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51] added
Oct 18 07:17:27 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f93bc9d-f747-4880-9989-6646b854a659]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1a361b-0254-4594-a58a-5131dffbe1cc]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dVRaBhHs {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dVRaBhHs" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2261549d-2c86-49a8-b71e-8f32545ffd6a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dVRaBhHs'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11eadcc-3be7-42db-8477-71bca9febbae]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[84708b0f-c836-477f-a17f-b881df47c3ce]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:17:27 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:17:27 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09973e1-2302-4381-b3ae-456a7f6b9968]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51, portal: 172.16.0.220,3260]
Oct 18 07:17:27 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51, portal: 172.16.0.220,3260] successful.
Oct 18 07:17:27 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8a1681-d3f3-48b0-b0b4-6226d8da2184]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceec5aa6-ce52-4bd8-acc7-c028ab3c1100]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:17:27 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:17:27 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:17:27 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:17:27 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be305ea-130b-41af-b855-bc9faeff6e8b]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:17:27 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVRaBhHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26164646339313734', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164646339313734', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2069033531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2069033531',id=14,image_ref='6e9b51ac-6787-450d-a1b2-66b2e1d58f5b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1908131829',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-rrzz9okk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member',shelved_at='2023-10-18T07:15:13.600972',shelved_host='user',shelved_image_id='6e9b51ac-6787-450d-a1b2-66b2e1d58f5b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=6875e226-7b26-4c33-a180-b08239799e69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'pci_devices' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.objects.base [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Object Instance<6875e226-7b26-4c33-a180-b08239799e69> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:17:28 user nova-compute[74587]:   <uuid>6875e226-7b26-4c33-a180-b08239799e69</uuid>
Oct 18 07:17:28 user nova-compute[74587]:   <name>instance-0000000e</name>
Oct 18 07:17:28 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:17:28 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:17:28 user nova-compute[74587]:   <metadata>
Oct 18 07:17:28 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:17:28 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:17:28 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2069033531</nova:name>
Oct 18 07:17:28 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:17:27</nova:creationTime>
Oct 18 07:17:28 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:17:28 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:17:28 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:17:28 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:17:28 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:17:28 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:17:28 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:17:28 user nova-compute[74587]:       <nova:owner>
Oct 18 07:17:28 user nova-compute[74587]:         <nova:user uuid="af9278b67f224f1695c90223a4dc1181">tempest-AttachVolumeShelveTestJSON-1000148669-project-member</nova:user>
Oct 18 07:17:28 user nova-compute[74587]:         <nova:project uuid="35bbc4b5dcf34f2a8eedb939389e7234">tempest-AttachVolumeShelveTestJSON-1000148669</nova:project>
Oct 18 07:17:28 user nova-compute[74587]:       </nova:owner>
Oct 18 07:17:28 user nova-compute[74587]:       <nova:root type="image" uuid="6e9b51ac-6787-450d-a1b2-66b2e1d58f5b"/>
Oct 18 07:17:28 user nova-compute[74587]:       <nova:ports>
Oct 18 07:17:28 user nova-compute[74587]:         <nova:port uuid="6059c685-1a4c-4810-b1ce-e215a3d5480e">
Oct 18 07:17:28 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 07:17:28 user nova-compute[74587]:         </nova:port>
Oct 18 07:17:28 user nova-compute[74587]:       </nova:ports>
Oct 18 07:17:28 user nova-compute[74587]:     </nova:instance>
Oct 18 07:17:28 user nova-compute[74587]:   </metadata>
Oct 18 07:17:28 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:17:28 user nova-compute[74587]:     <system>
Oct 18 07:17:28 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:17:28 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:17:28 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:17:28 user nova-compute[74587]:       <entry name="serial">6875e226-7b26-4c33-a180-b08239799e69</entry>
Oct 18 07:17:28 user nova-compute[74587]:       <entry name="uuid">6875e226-7b26-4c33-a180-b08239799e69</entry>
Oct 18 07:17:28 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:17:28 user nova-compute[74587]:     </system>
Oct 18 07:17:28 user nova-compute[74587]:   </sysinfo>
Oct 18 07:17:28 user nova-compute[74587]:   <os>
Oct 18 07:17:28 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:17:28 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:17:28 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:17:28 user nova-compute[74587]:   </os>
Oct 18 07:17:28 user nova-compute[74587]:   <features>
Oct 18 07:17:28 user nova-compute[74587]:     <acpi/>
Oct 18 07:17:28 user nova-compute[74587]:     <apic/>
Oct 18 07:17:28 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:17:28 user nova-compute[74587]:   </features>
Oct 18 07:17:28 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:17:28 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:17:28 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:17:28 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:17:28 user nova-compute[74587]:   </clock>
Oct 18 07:17:28 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:17:28 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:17:28 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:17:28 user nova-compute[74587]:   </cpu>
Oct 18 07:17:28 user nova-compute[74587]:   <devices>
Oct 18 07:17:28 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:17:28 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:17:28 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk"/>
Oct 18 07:17:28 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:17:28 user nova-compute[74587]:     </disk>
Oct 18 07:17:28 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:17:28 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:17:28 user nova-compute[74587]:       <source dev="/dev/sdb"/>
Oct 18 07:17:28 user nova-compute[74587]:       <target dev="vdc" bus="virtio"/>
Oct 18 07:17:28 user nova-compute[74587]:       <serial>88a6bf44-a044-4ad4-886f-a8cad2d05f51</serial>
Oct 18 07:17:28 user nova-compute[74587]:     </disk>
Oct 18 07:17:28 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:17:28 user nova-compute[74587]:       <mac address="fa:16:3e:72:97:53"/>
Oct 18 07:17:28 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:17:28 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:17:28 user nova-compute[74587]:       <target dev="tap6059c685-1a"/>
Oct 18 07:17:28 user nova-compute[74587]:     </interface>
Oct 18 07:17:28 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:17:28 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/console.log" append="off"/>
Oct 18 07:17:28 user nova-compute[74587]:     </serial>
Oct 18 07:17:28 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:17:28 user nova-compute[74587]:     <video>
Oct 18 07:17:28 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:17:28 user nova-compute[74587]:     </video>
Oct 18 07:17:28 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:17:28 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:17:28 user nova-compute[74587]:     </rng>
Oct 18 07:17:28 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:17:28 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:17:28 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:17:28 user nova-compute[74587]:     </memballoon>
Oct 18 07:17:28 user nova-compute[74587]:   </devices>
Oct 18 07:17:28 user nova-compute[74587]: </domain>
Oct 18 07:17:28 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2069033531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2069033531',id=14,image_ref='6e9b51ac-6787-450d-a1b2-66b2e1d58f5b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1908131829',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-rrzz9okk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member',shelved_at='2023-10-18T07:15:13.600972',shelved_host='user',shelved_image_id='6e9b51ac-6787-450d-a1b2-66b2e1d58f5b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=6875e226-7b26-4c33-a180-b08239799e69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG os_vif [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33fcffde-1398-50ce-836c-c7c201051efe', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6059c685-1a, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6059c685-1a, col_values=(('qos', UUID('8d322959-13c4-4d14-a630-23e6139d485a')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6059c685-1a, col_values=(('external_ids', {'iface-id': '6059c685-1a4c-4810-b1ce-e215a3d5480e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:97:53', 'vm-uuid': '6875e226-7b26-4c33-a180-b08239799e69'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:28 user nova-compute[74587]: INFO os_vif [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a')
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:17:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] No VIF found with MAC fa:16:3e:72:97:53, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:17:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-dcdfd72b-bcea-4fa2-b035-ccfb6042eea9 req-c9524936-a7f3-4939-b2fa-dbad40f4ca94 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:17:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dcdfd72b-bcea-4fa2-b035-ccfb6042eea9 req-c9524936-a7f3-4939-b2fa-dbad40f4ca94 service nova] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dcdfd72b-bcea-4fa2-b035-ccfb6042eea9 req-c9524936-a7f3-4939-b2fa-dbad40f4ca94 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dcdfd72b-bcea-4fa2-b035-ccfb6042eea9 req-c9524936-a7f3-4939-b2fa-dbad40f4ca94 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-dcdfd72b-bcea-4fa2-b035-ccfb6042eea9 req-c9524936-a7f3-4939-b2fa-dbad40f4ca94 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] No waiting events found dispatching network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:17:30 user nova-compute[74587]: WARNING nova.compute.manager [req-dcdfd72b-bcea-4fa2-b035-ccfb6042eea9 req-c9524936-a7f3-4939-b2fa-dbad40f4ca94 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received unexpected event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 07:17:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-484903d0-1909-4450-a3db-a367d40f222e req-b0a9cad1-d34c-45ee-99cc-e4292d2fd4f2 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:17:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-484903d0-1909-4450-a3db-a367d40f222e req-b0a9cad1-d34c-45ee-99cc-e4292d2fd4f2 service nova] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-484903d0-1909-4450-a3db-a367d40f222e req-b0a9cad1-d34c-45ee-99cc-e4292d2fd4f2 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-484903d0-1909-4450-a3db-a367d40f222e req-b0a9cad1-d34c-45ee-99cc-e4292d2fd4f2 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-484903d0-1909-4450-a3db-a367d40f222e req-b0a9cad1-d34c-45ee-99cc-e4292d2fd4f2 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] No waiting events found dispatching network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:17:32 user nova-compute[74587]: WARNING nova.compute.manager [req-484903d0-1909-4450-a3db-a367d40f222e req-b0a9cad1-d34c-45ee-99cc-e4292d2fd4f2 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received unexpected event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 07:17:32 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:17:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:17:32 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Instance spawned successfully.
Oct 18 07:17:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:17:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b6552932-99b3-4bf3-ab96-8cb5f50dcf4f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 31.461s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:17:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:17:37 user nova-compute[74587]: INFO nova.compute.claims [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Claim successful on node user
Oct 18 07:17:37 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:17:37 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:17:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:17:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG nova.policy [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aceede4662a4aaa92c79dfd538effea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc0eafb55fd4673a3d8fcb0e63602c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:17:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Creating image(s)
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "/opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "/opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.215s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk 1073741824" returned: 0 in 0.053s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Successfully created port: 5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.262s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:17:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Cannot resize image /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Ensure instance console log exists: /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Successfully updated port: 5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "refresh_cache-b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquired lock "refresh_cache-b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-d86ab143-5a6e-482d-a57a-2ee82033310a req-7510f437-0e58-4256-bd0e-58aabf2480e3 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received event network-changed-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-d86ab143-5a6e-482d-a57a-2ee82033310a req-7510f437-0e58-4256-bd0e-58aabf2480e3 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Refreshing instance network info cache due to event network-changed-5943d9a8-1bde-4fec-809b-c2887cf98dc6. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d86ab143-5a6e-482d-a57a-2ee82033310a req-7510f437-0e58-4256-bd0e-58aabf2480e3 service nova] Acquiring lock "refresh_cache-b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Updating instance_info_cache with network_info: [{"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Releasing lock "refresh_cache-b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.compute.manager [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Instance network_info: |[{"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d86ab143-5a6e-482d-a57a-2ee82033310a req-7510f437-0e58-4256-bd0e-58aabf2480e3 service nova] Acquired lock "refresh_cache-b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.network.neutron [req-d86ab143-5a6e-482d-a57a-2ee82033310a req-7510f437-0e58-4256-bd0e-58aabf2480e3 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Refreshing network info cache for port 5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:17:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Start _get_guest_xml network_info=[{"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:17:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:17:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-180971638',display_name='tempest-AttachVolumeNegativeTest-server-180971638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-180971638',id=20,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkVxS9OBxn1DlPHxFEpD3VFGmdSz17qhlp/r9JxNnYfQ0YYvloKFPyDvAuSKU6SH+RP2EA8odbdr9Dgh9V10WCkYTfVBVKnohiDdaFDs5uJWcs9SRTY4Yhe7LsnXg9fdA==',key_name='tempest-keypair-559186231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-vzy56vtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=b1c2c7fb-7f42-49df-9d7b-706dffa5a6db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:1c:3e,bridge_name='br-int',has_traffic_filtering=True,id=5943d9a8-1bde-4fec-809b-c2887cf98dc6,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5943d9a8-1b') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.objects.instance [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'pci_devices' on Instance uuid b1c2c7fb-7f42-49df-9d7b-706dffa5a6db {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:17:40 user nova-compute[74587]:   <uuid>b1c2c7fb-7f42-49df-9d7b-706dffa5a6db</uuid>
Oct 18 07:17:40 user nova-compute[74587]:   <name>instance-00000014</name>
Oct 18 07:17:40 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:17:40 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:17:40 user nova-compute[74587]:   <metadata>
Oct 18 07:17:40 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:17:40 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:17:40 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeNegativeTest-server-180971638</nova:name>
Oct 18 07:17:40 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:17:40</nova:creationTime>
Oct 18 07:17:40 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:17:40 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:17:40 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:17:40 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:17:40 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:17:40 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:17:40 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:17:40 user nova-compute[74587]:       <nova:owner>
Oct 18 07:17:40 user nova-compute[74587]:         <nova:user uuid="8aceede4662a4aaa92c79dfd538effea">tempest-AttachVolumeNegativeTest-859195449-project-member</nova:user>
Oct 18 07:17:40 user nova-compute[74587]:         <nova:project uuid="0cc0eafb55fd4673a3d8fcb0e63602c7">tempest-AttachVolumeNegativeTest-859195449</nova:project>
Oct 18 07:17:40 user nova-compute[74587]:       </nova:owner>
Oct 18 07:17:40 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:17:40 user nova-compute[74587]:       <nova:ports>
Oct 18 07:17:40 user nova-compute[74587]:         <nova:port uuid="5943d9a8-1bde-4fec-809b-c2887cf98dc6">
Oct 18 07:17:40 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 18 07:17:40 user nova-compute[74587]:         </nova:port>
Oct 18 07:17:40 user nova-compute[74587]:       </nova:ports>
Oct 18 07:17:40 user nova-compute[74587]:     </nova:instance>
Oct 18 07:17:40 user nova-compute[74587]:   </metadata>
Oct 18 07:17:40 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:17:40 user nova-compute[74587]:     <system>
Oct 18 07:17:40 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:17:40 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:17:40 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:17:40 user nova-compute[74587]:       <entry name="serial">b1c2c7fb-7f42-49df-9d7b-706dffa5a6db</entry>
Oct 18 07:17:40 user nova-compute[74587]:       <entry name="uuid">b1c2c7fb-7f42-49df-9d7b-706dffa5a6db</entry>
Oct 18 07:17:40 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:17:40 user nova-compute[74587]:     </system>
Oct 18 07:17:40 user nova-compute[74587]:   </sysinfo>
Oct 18 07:17:40 user nova-compute[74587]:   <os>
Oct 18 07:17:40 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:17:40 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:17:40 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:17:40 user nova-compute[74587]:   </os>
Oct 18 07:17:40 user nova-compute[74587]:   <features>
Oct 18 07:17:40 user nova-compute[74587]:     <acpi/>
Oct 18 07:17:40 user nova-compute[74587]:     <apic/>
Oct 18 07:17:40 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:17:40 user nova-compute[74587]:   </features>
Oct 18 07:17:40 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:17:40 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:17:40 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:17:40 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:17:40 user nova-compute[74587]:   </clock>
Oct 18 07:17:40 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:17:40 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:17:40 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:17:40 user nova-compute[74587]:   </cpu>
Oct 18 07:17:40 user nova-compute[74587]:   <devices>
Oct 18 07:17:40 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:17:40 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:17:40 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk"/>
Oct 18 07:17:40 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:17:40 user nova-compute[74587]:     </disk>
Oct 18 07:17:40 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:17:40 user nova-compute[74587]:       <mac address="fa:16:3e:81:1c:3e"/>
Oct 18 07:17:40 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:17:40 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:17:40 user nova-compute[74587]:       <target dev="tap5943d9a8-1b"/>
Oct 18 07:17:40 user nova-compute[74587]:     </interface>
Oct 18 07:17:40 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:17:40 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/console.log" append="off"/>
Oct 18 07:17:40 user nova-compute[74587]:     </serial>
Oct 18 07:17:40 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:17:40 user nova-compute[74587]:     <video>
Oct 18 07:17:40 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:17:40 user nova-compute[74587]:     </video>
Oct 18 07:17:40 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:17:40 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:17:40 user nova-compute[74587]:     </rng>
Oct 18 07:17:40 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:17:40 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:17:40 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:17:40 user nova-compute[74587]:     </memballoon>
Oct 18 07:17:40 user nova-compute[74587]:   </devices>
Oct 18 07:17:40 user nova-compute[74587]: </domain>
Oct 18 07:17:40 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-180971638',display_name='tempest-AttachVolumeNegativeTest-server-180971638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-180971638',id=20,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkVxS9OBxn1DlPHxFEpD3VFGmdSz17qhlp/r9JxNnYfQ0YYvloKFPyDvAuSKU6SH+RP2EA8odbdr9Dgh9V10WCkYTfVBVKnohiDdaFDs5uJWcs9SRTY4Yhe7LsnXg9fdA==',key_name='tempest-keypair-559186231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-vzy56vtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=b1c2c7fb-7f42-49df-9d7b-706dffa5a6db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:1c:3e,bridge_name='br-int',has_traffic_filtering=True,id=5943d9a8-1bde-4fec-809b-c2887cf98dc6,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5943d9a8-1b') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG os_vif [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:1c:3e,bridge_name='br-int',has_traffic_filtering=True,id=5943d9a8-1bde-4fec-809b-c2887cf98dc6,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5943d9a8-1b') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36cd64a3-49cb-59d3-93cd-de3aa9104f20', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5943d9a8-1b, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5943d9a8-1b, col_values=(('qos', UUID('1671e895-2636-4e5b-9c04-6c29da97528e')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5943d9a8-1b, col_values=(('external_ids', {'iface-id': '5943d9a8-1bde-4fec-809b-c2887cf98dc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:1c:3e', 'vm-uuid': 'b1c2c7fb-7f42-49df-9d7b-706dffa5a6db'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:40 user nova-compute[74587]: INFO os_vif [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:1c:3e,bridge_name='br-int',has_traffic_filtering=True,id=5943d9a8-1bde-4fec-809b-c2887cf98dc6,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5943d9a8-1b')
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No VIF found with MAC fa:16:3e:81:1c:3e, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-d86ab143-5a6e-482d-a57a-2ee82033310a req-7510f437-0e58-4256-bd0e-58aabf2480e3 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Updated VIF entry in instance network info cache for port 5943d9a8-1bde-4fec-809b-c2887cf98dc6. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-d86ab143-5a6e-482d-a57a-2ee82033310a req-7510f437-0e58-4256-bd0e-58aabf2480e3 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Updating instance_info_cache with network_info: [{"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:17:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d86ab143-5a6e-482d-a57a-2ee82033310a req-7510f437-0e58-4256-bd0e-58aabf2480e3 service nova] Releasing lock "refresh_cache-b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-9fb5f256-a914-454a-9115-0126912fb6a9 req-eabc4c2d-869c-4571-8d8d-7627d4ca2713 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-changed-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-9fb5f256-a914-454a-9115-0126912fb6a9 req-eabc4c2d-869c-4571-8d8d-7627d4ca2713 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Refreshing instance network info cache due to event network-changed-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9fb5f256-a914-454a-9115-0126912fb6a9 req-eabc4c2d-869c-4571-8d8d-7627d4ca2713 service nova] Acquiring lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9fb5f256-a914-454a-9115-0126912fb6a9 req-eabc4c2d-869c-4571-8d8d-7627d4ca2713 service nova] Acquired lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG nova.network.neutron [req-9fb5f256-a914-454a-9115-0126912fb6a9 req-eabc4c2d-869c-4571-8d8d-7627d4ca2713 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Refreshing network info cache for port 5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-ea0c3412-a381-4abf-9b57-be95c7bca3f7 req-945a78ac-0268-4616-8e7a-acd5b2510548 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received event network-vif-plugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ea0c3412-a381-4abf-9b57-be95c7bca3f7 req-945a78ac-0268-4616-8e7a-acd5b2510548 service nova] Acquiring lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ea0c3412-a381-4abf-9b57-be95c7bca3f7 req-945a78ac-0268-4616-8e7a-acd5b2510548 service nova] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ea0c3412-a381-4abf-9b57-be95c7bca3f7 req-945a78ac-0268-4616-8e7a-acd5b2510548 service nova] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-ea0c3412-a381-4abf-9b57-be95c7bca3f7 req-945a78ac-0268-4616-8e7a-acd5b2510548 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] No waiting events found dispatching network-vif-plugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:17:41 user nova-compute[74587]: WARNING nova.compute.manager [req-ea0c3412-a381-4abf-9b57-be95c7bca3f7 req-945a78ac-0268-4616-8e7a-acd5b2510548 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received unexpected event network-vif-plugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 for instance with vm_state building and task_state spawning.
Oct 18 07:17:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-9fb5f256-a914-454a-9115-0126912fb6a9 req-eabc4c2d-869c-4571-8d8d-7627d4ca2713 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updated VIF entry in instance network info cache for port 5a276ea0-c80e-4c21-b65f-6fa7e10c58ba. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:17:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-9fb5f256-a914-454a-9115-0126912fb6a9 req-eabc4c2d-869c-4571-8d8d-7627d4ca2713 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updating instance_info_cache with network_info: [{"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:17:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9fb5f256-a914-454a-9115-0126912fb6a9 req-eabc4c2d-869c-4571-8d8d-7627d4ca2713 service nova] Releasing lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG nova.objects.instance [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'flavor' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:43 user nova-compute[74587]: INFO nova.compute.manager [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Attaching volume 94716aab-85c6-4930-8178-e355a0a16be3 to /dev/vdb
Oct 18 07:17:43 user nova-compute[74587]: DEBUG os_brick.utils [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dbe44e-af34-471d-9b5f-7babf237075e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d8b00b-dbe1-4662-8fc4-666056d3fb24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.081s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b31df5-9d1c-45df-b6b7-43d454d652bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0047ccb7-8087-45ee-bcaf-71ca6a22f35e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:17:43 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:17:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b56235c-6a62-4ecc-9540-ddfd67c453c3]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG os_brick.utils [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:17:43 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updating existing volume attachment record: 5a2ebeac-b279-454d-9cbb-182604bd021c {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-18327638-b16f-4375-bb5b-6ea654a7a32e req-3011a73b-0e99-40d6-98e7-816b4f651b59 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received event network-vif-plugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-18327638-b16f-4375-bb5b-6ea654a7a32e req-3011a73b-0e99-40d6-98e7-816b4f651b59 service nova] Acquiring lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-18327638-b16f-4375-bb5b-6ea654a7a32e req-3011a73b-0e99-40d6-98e7-816b4f651b59 service nova] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-18327638-b16f-4375-bb5b-6ea654a7a32e req-3011a73b-0e99-40d6-98e7-816b4f651b59 service nova] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-18327638-b16f-4375-bb5b-6ea654a7a32e req-3011a73b-0e99-40d6-98e7-816b4f651b59 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] No waiting events found dispatching network-vif-plugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:17:44 user nova-compute[74587]: WARNING nova.compute.manager [req-18327638-b16f-4375-bb5b-6ea654a7a32e req-3011a73b-0e99-40d6-98e7-816b4f651b59 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received unexpected event network-vif-plugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 for instance with vm_state building and task_state spawning.
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:17:44 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Instance spawned successfully.
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:17:44 user nova-compute[74587]: INFO nova.compute.manager [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Took 6.23 seconds to spawn the instance on the hypervisor.
Oct 18 07:17:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:17:44 user nova-compute[74587]: INFO nova.compute.manager [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Took 7.14 seconds to build instance.
Oct 18 07:17:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-078bfcd4-4b8e-4229-b9ea-e7e7e1abbed1 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.250s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG nova.objects.instance [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lazy-loading 'flavor' on Instance uuid 7c0cae36-8828-4b06-aab2-29e38e6cfaf2 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:49 user nova-compute[74587]: INFO nova.compute.manager [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Attaching volume 40b4b653-2245-468d-9ac0-5d66a2d7cc75 to /dev/vdb
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'flavor' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG os_brick.utils [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[559bf136-104a-46bb-bd41-cfdae5a2a7fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc9eff1-7599-41e6-849d-84a1e6c1345f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a0ec0c-b579-4479-8fa2-a1f485612297]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e34ef30-c1b0-4893-9a71-687542e134f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:17:50 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7e6f3a-993d-4c3a-87df-0346d428dab3]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.utils [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Updating existing volume attachment record: 3f3931a5-3aa6-4e14-81b5-e339766dd90f {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:17:50 user nova-compute[74587]: INFO nova.compute.manager [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Attaching volume e5e6656c-aaeb-46ff-855f-0427de81cb51 to /dev/vdb
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.utils [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afc6ac0-cc56-436e-9f92-3f76ecf3c2b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[147f20c1-5af1-4a96-9ccb-cfcf2cd82d46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0ed658-3fb0-4f15-89a8-964045f2827b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7216b922-2544-4d78-92b2-a7854f11fc17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:17:50 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:17:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c75f00-0db0-4d5a-ad45-e8ab4c1e4971]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG os_brick.utils [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:17:50 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updating existing volume attachment record: 883094ee-05a4-4f05-b790-034b9dad16bc {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:17:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:17:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:18:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:18:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKwUOrpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:18:07 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:18:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:18:07 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:18:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:18:07 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:18:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ca9740-f516-4edf-9593-18ec106b4b4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:18:07 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[df308795-39fa-49ca-911e-0a3d3e071114]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3] added
Oct 18 07:18:07 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8c809b-3f05-45ab-b708-13af196467de]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.071s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab3ad32-cf28-4c9a-8887-b69d464bd9b9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yKwUOrpW {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yKwUOrpW" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd63df5b-6500-4308-b8c8-79351526dfb1]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yKwUOrpW'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e57513-96d6-4316-bc81-5e842572d13c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf4ac67-8577-4d0f-a734-3df5e9b53d85]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:08 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:08 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cedd8c-bc40-4ff7-9ebc-0c9d15ef0820]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3, portal: 172.16.0.220,3260]
Oct 18 07:18:08 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3, portal: 172.16.0.220,3260] successful.
Oct 18 07:18:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cfeebc-69f3-4be7-8881-f4722b61b2ea]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[020ae811-2ff3-4ca2-9995-ff4c64b950ec]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:08 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:08 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:08 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:08 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca64f291-d4b7-41d5-9ebf-dee559990392]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKwUOrpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anLrkbNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:18:08 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:18:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23937633736336161', 'path': '/dev/sdd'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937633736336161', 'path': '/dev/sdd'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.525s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:18:09 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:18:09 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG nova.objects.instance [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'flavor' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b369694-dc8e-4cd9-bb02-24de4ae2f8f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:18:09 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:18:09 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:18:09 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:18:09 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:18:09 user nova-compute[74587]:   <serial>94716aab-85c6-4930-8178-e355a0a16be3</serial>
Oct 18 07:18:09 user nova-compute[74587]: </disk>
Oct 18 07:18:09 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[09de3a57-96c6-4e04-9f61-0f9198dc9a85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51] added
Oct 18 07:18:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b71057-d872-4ad2-a1af-d26c6766c62d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[58151fcd-7d2c-4333-86e6-1a49a3fe9e60]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anLrkbNy {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anLrkbNy" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cb1312-9ff2-4e44-bb71-3bc9c2be19d0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'anLrkbNy'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a9bf84-b38a-4d66-8834-dc4724d3047d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[693ae737-5458-42c8-af0a-df5f4fcb700f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:09 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:09 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:09 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:09 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef095d39-294e-417d-ab75-032bf2c810b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51, portal: 172.16.0.220,3260]
Oct 18 07:18:09 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51, portal: 172.16.0.220,3260] successful.
Oct 18 07:18:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.138s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f8144-9d4f-49d0-8f8c-85d6cfa86156]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4408ce40-898d-46d2-ad30-60bb0ec6c836]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:09 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:09 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:09 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:18:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:09 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:09 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:09 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:18:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7520542-87dd-4f0e-a5b9-87ee96b61bcc]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No VIF found with MAC fa:16:3e:bd:d8:17, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:18:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1abee9c2-9b78-414e-b5ae-694970d7b123 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.649s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:10 user nova-compute[74587]: INFO nova.compute.manager [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Rescuing
Oct 18 07:18:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:18:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquired lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:18:10 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:18:10 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:18:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anLrkbNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:18:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:18:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] <== connect_volume: return (1968ms) {'type': 'block', 'scsi_wwn': '23466666366303266', 'path': '/dev/sde'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:18:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466666366303266', 'path': '/dev/sde'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:18:10 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'flavor' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:18:10 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:18:10 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:18:10 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:18:10 user nova-compute[74587]:   <serial>e5e6656c-aaeb-46ff-855f-0427de81cb51</serial>
Oct 18 07:18:10 user nova-compute[74587]: </disk>
Oct 18 07:18:10 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] No VIF found with MAC fa:16:3e:db:3e:e9, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updating instance_info_cache with network_info: [{"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Releasing lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e013ac1e-ab6e-4ba1-8067-59704db590e1 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.395s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-c8cc73d0-8b1a-4dd7-8b1a-a741819e3976 req-d3ec871c-6eae-4f01-a832-550dd244fb25 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-unplugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c8cc73d0-8b1a-4dd7-8b1a-a741819e3976 req-d3ec871c-6eae-4f01-a832-550dd244fb25 service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c8cc73d0-8b1a-4dd7-8b1a-a741819e3976 req-d3ec871c-6eae-4f01-a832-550dd244fb25 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c8cc73d0-8b1a-4dd7-8b1a-a741819e3976 req-d3ec871c-6eae-4f01-a832-550dd244fb25 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-c8cc73d0-8b1a-4dd7-8b1a-a741819e3976 req-d3ec871c-6eae-4f01-a832-550dd244fb25 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-unplugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:12 user nova-compute[74587]: WARNING nova.compute.manager [req-c8cc73d0-8b1a-4dd7-8b1a-a741819e3976 req-d3ec871c-6eae-4f01-a832-550dd244fb25 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-unplugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state active and task_state rescuing.
Oct 18 07:18:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating instance_info_cache with network_info: [{"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-6875e226-7b26-4c33-a180-b08239799e69" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Instance destroyed successfully.
Oct 18 07:18:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Attempting rescue
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74587) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Instance directory exists: not creating {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 07:18:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Creating image(s)
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'trusted_certs' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue" returned: 0 in 0.062s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'migration_context' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:12 user nova-compute[74587]: INFO nova.compute.manager [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Rescuing
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquired lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.base [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<e82e7877-9569-4a62-9fff-48d4bcca3848> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Start _get_guest_xml network_info=[{"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "vif_mac": "fa:16:3e:bd:d8:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'resources' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.base [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<e82e7877-9569-4a62-9fff-48d4bcca3848> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'numa_topology' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.base [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<e82e7877-9569-4a62-9fff-48d4bcca3848> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:18:12 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:18:12 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'vcpu_model' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.base [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<e82e7877-9569-4a62-9fff-48d4bcca3848> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-356048251',display_name='tempest-ServerRescueNegativeTestJSON-server-356048251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-356048251',id=17,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5wq4FSXcSbqJDyU+OCrgV4Dw18pW88quoCGsPjcRGFr/Vma5g8ZVmcXLz7dQcu8B5T0mLVa+LScc0/X9fEMYB00IwJr46Pm9jpd4R0eouPbrfgia1GPucA9GEpLtdq5Q==',key_name='tempest-keypair-2077577956',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:15:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-h5kpvvnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96efd41052434514aea7fe47a5eb36f7',uuid=e82e7877-9569-4a62-9fff-48d4bcca3848,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "vif_mac": "fa:16:3e:bd:d8:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "vif_mac": "fa:16:3e:bd:d8:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d8:17,bridge_name='br-int',has_traffic_filtering=True,id=5a276ea0-c80e-4c21-b65f-6fa7e10c58ba,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a276ea0-c8') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'pci_devices' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.objects.base [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Object Instance<e82e7877-9569-4a62-9fff-48d4bcca3848> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:18:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:18:12 user nova-compute[74587]:   <uuid>e82e7877-9569-4a62-9fff-48d4bcca3848</uuid>
Oct 18 07:18:12 user nova-compute[74587]:   <name>instance-00000011</name>
Oct 18 07:18:12 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:18:12 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:18:12 user nova-compute[74587]:   <metadata>
Oct 18 07:18:12 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:18:12 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:18:12 user nova-compute[74587]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-356048251</nova:name>
Oct 18 07:18:12 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:18:12</nova:creationTime>
Oct 18 07:18:12 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:18:12 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:18:12 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:18:12 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:18:12 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:18:12 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:18:12 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:18:12 user nova-compute[74587]:       <nova:owner>
Oct 18 07:18:12 user nova-compute[74587]:         <nova:user uuid="96efd41052434514aea7fe47a5eb36f7">tempest-ServerRescueNegativeTestJSON-1222499333-project-member</nova:user>
Oct 18 07:18:12 user nova-compute[74587]:         <nova:project uuid="1b1dbea9d8d34471b74b5c002f5905f0">tempest-ServerRescueNegativeTestJSON-1222499333</nova:project>
Oct 18 07:18:12 user nova-compute[74587]:       </nova:owner>
Oct 18 07:18:12 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:18:12 user nova-compute[74587]:       <nova:ports>
Oct 18 07:18:12 user nova-compute[74587]:         <nova:port uuid="5a276ea0-c80e-4c21-b65f-6fa7e10c58ba">
Oct 18 07:18:12 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 18 07:18:12 user nova-compute[74587]:         </nova:port>
Oct 18 07:18:12 user nova-compute[74587]:       </nova:ports>
Oct 18 07:18:12 user nova-compute[74587]:     </nova:instance>
Oct 18 07:18:12 user nova-compute[74587]:   </metadata>
Oct 18 07:18:12 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:18:12 user nova-compute[74587]:     <system>
Oct 18 07:18:12 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:18:12 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:18:12 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:18:12 user nova-compute[74587]:       <entry name="serial">e82e7877-9569-4a62-9fff-48d4bcca3848</entry>
Oct 18 07:18:12 user nova-compute[74587]:       <entry name="uuid">e82e7877-9569-4a62-9fff-48d4bcca3848</entry>
Oct 18 07:18:12 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:18:12 user nova-compute[74587]:     </system>
Oct 18 07:18:12 user nova-compute[74587]:   </sysinfo>
Oct 18 07:18:12 user nova-compute[74587]:   <os>
Oct 18 07:18:12 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:18:12 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:18:12 user nova-compute[74587]:   </os>
Oct 18 07:18:12 user nova-compute[74587]:   <features>
Oct 18 07:18:12 user nova-compute[74587]:     <acpi/>
Oct 18 07:18:12 user nova-compute[74587]:     <apic/>
Oct 18 07:18:12 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:18:12 user nova-compute[74587]:   </features>
Oct 18 07:18:12 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:18:12 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:18:12 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:18:12 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:18:12 user nova-compute[74587]:   </clock>
Oct 18 07:18:12 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:18:12 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:18:12 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:18:12 user nova-compute[74587]:   </cpu>
Oct 18 07:18:12 user nova-compute[74587]:   <devices>
Oct 18 07:18:12 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:18:12 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:18:12 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue"/>
Oct 18 07:18:12 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:18:12 user nova-compute[74587]:     </disk>
Oct 18 07:18:12 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:18:12 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:18:12 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk"/>
Oct 18 07:18:12 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:18:12 user nova-compute[74587]:     </disk>
Oct 18 07:18:12 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:18:12 user nova-compute[74587]:       <mac address="fa:16:3e:bd:d8:17"/>
Oct 18 07:18:12 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:18:12 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:18:12 user nova-compute[74587]:       <target dev="tap5a276ea0-c8"/>
Oct 18 07:18:12 user nova-compute[74587]:     </interface>
Oct 18 07:18:12 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:18:12 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/console.log" append="off"/>
Oct 18 07:18:12 user nova-compute[74587]:     </serial>
Oct 18 07:18:12 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:18:12 user nova-compute[74587]:     <video>
Oct 18 07:18:12 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:18:12 user nova-compute[74587]:     </video>
Oct 18 07:18:12 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:18:12 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:18:12 user nova-compute[74587]:     </rng>
Oct 18 07:18:12 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:18:12 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:18:12 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:18:12 user nova-compute[74587]:     </memballoon>
Oct 18 07:18:12 user nova-compute[74587]:   </devices>
Oct 18 07:18:12 user nova-compute[74587]: </domain>
Oct 18 07:18:12 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:18:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Instance destroyed successfully.
Oct 18 07:18:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] No VIF found with MAC fa:16:3e:bd:d8:17, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updating instance_info_cache with network_info: [{"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Releasing lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:13 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:18:13 user nova-compute[74587]: INFO nova.compute.claims [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Claim successful on node user
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:14 user nova-compute[74587]: WARNING nova.compute.manager [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state active and task_state rescuing.
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-unplugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-unplugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:14 user nova-compute[74587]: WARNING nova.compute.manager [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-unplugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state active and task_state rescuing.
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:14 user nova-compute[74587]: WARNING nova.compute.manager [req-f073bb85-2d1a-44fb-9863-a57f41e5d91d req-6fe5546a-16b7-463f-a42e-3642e483ec60 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state active and task_state rescuing.
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.654s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:18:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.policy [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b1730cd79c54e748232c046b4d3e412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196ea516329b4e479bd8f54644007c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:18:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Creating image(s)
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "/opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "/opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "/opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Instance destroyed successfully.
Oct 18 07:18:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Attempting a stable device rescue
Oct 18 07:18:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74587) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Instance directory exists: not creating {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 07:18:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Creating image(s)
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:14 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'trusted_certs' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "6aacba4e547065f6269446fc0811fb891923919d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "6aacba4e547065f6269446fc0811fb891923919d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.218s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d.part --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Successfully created port: deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 1.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:16 user nova-compute[74587]: WARNING nova.compute.manager [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state active and task_state rescuing.
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:16 user nova-compute[74587]: WARNING nova.compute.manager [req-8161bd84-6723-4d9a-b4f1-fb4c671c2362 req-1d1c7ff7-938f-45a6-ad7d-a34cc8253883 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state active and task_state rescuing.
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk 1073741824" returned: 0 in 0.057s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 1.233s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.virt.images [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] 03cd7700-1379-4e5e-ac22-4164d40d05f8 was qcow2, converting to raw {{(pid=74587) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d.part /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d.converted {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.227s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Cannot resize image /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Ensure instance console log exists: /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d.part /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d.converted" returned: 0 in 0.469s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d.converted --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Successfully updated port: deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "refresh_cache-57779903-c965-4099-b4fd-d934e02181dd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquired lock "refresh_cache-57779903-c965-4099-b4fd-d934e02181dd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-38ffd20d-6ca1-4458-b78a-eecc865a7e5c req-c28b90d9-7249-4a94-b681-b223a739007a service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-changed-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-38ffd20d-6ca1-4458-b78a-eecc865a7e5c req-c28b90d9-7249-4a94-b681-b223a739007a service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Refreshing instance network info cache due to event network-changed-deba39b8-e178-4b6a-bf64-6b36d2980719. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:18:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-38ffd20d-6ca1-4458-b78a-eecc865a7e5c req-c28b90d9-7249-4a94-b681-b223a739007a service nova] Acquiring lock "refresh_cache-57779903-c965-4099-b4fd-d934e02181dd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "6aacba4e547065f6269446fc0811fb891923919d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.013s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "6aacba4e547065f6269446fc0811fb891923919d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "6aacba4e547065f6269446fc0811fb891923919d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d --force-share --output=json" returned: 0 in 0.197s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d,backing_fmt=raw /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Updating instance_info_cache with network_info: [{"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d,backing_fmt=raw /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue" returned: 0 in 0.072s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "6aacba4e547065f6269446fc0811fb891923919d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'migration_context' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Object Instance<18ce6cb0-9632-4361-8d88-1b751e54ea71> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Start _get_guest_xml network_info=[{"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "vif_mac": "fa:16:3e:db:3e:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '03cd7700-1379-4e5e-ac22-4164d40d05f8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '883094ee-05a4-4f05-b790-034b9dad16bc', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anLrkbNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '18ce6cb0-9632-4361-8d88-1b751e54ea71', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5e6656c-aaeb-46ff-855f-0427de81cb51', 'serial': 'e5e6656c-aaeb-46ff-855f-0427de81cb51'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'resources' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Releasing lock "refresh_cache-57779903-c965-4099-b4fd-d934e02181dd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Instance network_info: |[{"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-38ffd20d-6ca1-4458-b78a-eecc865a7e5c req-c28b90d9-7249-4a94-b681-b223a739007a service nova] Acquired lock "refresh_cache-57779903-c965-4099-b4fd-d934e02181dd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.neutron [req-38ffd20d-6ca1-4458-b78a-eecc865a7e5c req-c28b90d9-7249-4a94-b681-b223a739007a service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Refreshing network info cache for port deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Start _get_guest_xml network_info=[{"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Object Instance<18ce6cb0-9632-4361-8d88-1b751e54ea71> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'numa_topology' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:17 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:18:17 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Object Instance<18ce6cb0-9632-4361-8d88-1b751e54ea71> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-131303816',display_name='tempest-tempest.common.compute-instance-131303816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-131303816',id=21,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtvGfBTkmICl93Y629GSp9vxRmRb7ktS6MkPEYxnd5r5dWprV6nU6Bni5nfUEjdsOZs2O5IEA4YwJeshclRhNFjFWY1pmae36/MF/uwYENjseuyRf+tfHlT2QHevzVfsg==',key_name='tempest-keypair-1663639896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-1mfq5t8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:18:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=57779903-c965-4099-b4fd-d934e02181dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'pci_devices' on Instance uuid 57779903-c965-4099-b4fd-d934e02181dd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:17 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:18:17 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fc90bc33-e6da-42f4-8377-6ecdfd366ecc tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'vcpu_model' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:18:17 user nova-compute[74587]:   <uuid>57779903-c965-4099-b4fd-d934e02181dd</uuid>
Oct 18 07:18:17 user nova-compute[74587]:   <name>instance-00000015</name>
Oct 18 07:18:17 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:18:17 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:18:17 user nova-compute[74587]:   <metadata>
Oct 18 07:18:17 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:18:17 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:name>tempest-tempest.common.compute-instance-131303816</nova:name>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:18:17</nova:creationTime>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:18:17 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:18:17 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:owner>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:user uuid="1b1730cd79c54e748232c046b4d3e412">tempest-ServerActionsTestOtherA-2039083727-project-member</nova:user>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:project uuid="196ea516329b4e479bd8f54644007c57">tempest-ServerActionsTestOtherA-2039083727</nova:project>
Oct 18 07:18:17 user nova-compute[74587]:       </nova:owner>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:ports>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:port uuid="deba39b8-e178-4b6a-bf64-6b36d2980719">
Oct 18 07:18:17 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 18 07:18:17 user nova-compute[74587]:         </nova:port>
Oct 18 07:18:17 user nova-compute[74587]:       </nova:ports>
Oct 18 07:18:17 user nova-compute[74587]:     </nova:instance>
Oct 18 07:18:17 user nova-compute[74587]:   </metadata>
Oct 18 07:18:17 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:18:17 user nova-compute[74587]:     <system>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="serial">57779903-c965-4099-b4fd-d934e02181dd</entry>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="uuid">57779903-c965-4099-b4fd-d934e02181dd</entry>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:18:17 user nova-compute[74587]:     </system>
Oct 18 07:18:17 user nova-compute[74587]:   </sysinfo>
Oct 18 07:18:17 user nova-compute[74587]:   <os>
Oct 18 07:18:17 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:18:17 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:18:17 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:18:17 user nova-compute[74587]:   </os>
Oct 18 07:18:17 user nova-compute[74587]:   <features>
Oct 18 07:18:17 user nova-compute[74587]:     <acpi/>
Oct 18 07:18:17 user nova-compute[74587]:     <apic/>
Oct 18 07:18:17 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:18:17 user nova-compute[74587]:   </features>
Oct 18 07:18:17 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:18:17 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:18:17 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:18:17 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:18:17 user nova-compute[74587]:   </clock>
Oct 18 07:18:17 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:18:17 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:18:17 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:18:17 user nova-compute[74587]:   </cpu>
Oct 18 07:18:17 user nova-compute[74587]:   <devices>
Oct 18 07:18:17 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:18:17 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:18:17 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk"/>
Oct 18 07:18:17 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:18:17 user nova-compute[74587]:     </disk>
Oct 18 07:18:17 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:18:17 user nova-compute[74587]:       <mac address="fa:16:3e:e4:25:0d"/>
Oct 18 07:18:17 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:18:17 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:18:17 user nova-compute[74587]:       <target dev="tapdeba39b8-e1"/>
Oct 18 07:18:17 user nova-compute[74587]:     </interface>
Oct 18 07:18:17 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:18:17 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/console.log" append="off"/>
Oct 18 07:18:17 user nova-compute[74587]:     </serial>
Oct 18 07:18:17 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:18:17 user nova-compute[74587]:     <video>
Oct 18 07:18:17 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:18:17 user nova-compute[74587]:     </video>
Oct 18 07:18:17 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:18:17 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:18:17 user nova-compute[74587]:     </rng>
Oct 18 07:18:17 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:18:17 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:18:17 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:18:17 user nova-compute[74587]:     </memballoon>
Oct 18 07:18:17 user nova-compute[74587]:   </devices>
Oct 18 07:18:17 user nova-compute[74587]: </domain>
Oct 18 07:18:17 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-131303816',display_name='tempest-tempest.common.compute-instance-131303816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-131303816',id=21,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtvGfBTkmICl93Y629GSp9vxRmRb7ktS6MkPEYxnd5r5dWprV6nU6Bni5nfUEjdsOZs2O5IEA4YwJeshclRhNFjFWY1pmae36/MF/uwYENjseuyRf+tfHlT2QHevzVfsg==',key_name='tempest-keypair-1663639896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-1mfq5t8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:18:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=57779903-c965-4099-b4fd-d934e02181dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_vif [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8cb11b7-c066-568a-a2e8-6f211c4bb408', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Object Instance<18ce6cb0-9632-4361-8d88-1b751e54ea71> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anLrkbNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:18:17 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:18:17 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:18:17 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdeba39b8-e1, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdeba39b8-e1, col_values=(('qos', UUID('3f255cce-0dac-4be3-a64a-1cde9b708219')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdeba39b8-e1, col_values=(('external_ids', {'iface-id': 'deba39b8-e178-4b6a-bf64-6b36d2980719', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:25:0d', 'vm-uuid': '57779903-c965-4099-b4fd-d934e02181dd'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec03a18-f3d6-4b62-ac7a-8a927a452026]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = anLrkbNy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 18 07:18:17 user nova-compute[74587]: node.name = iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51
Oct 18 07:18:17 user nova-compute[74587]: node.tpgt = -1
Oct 18 07:18:17 user nova-compute[74587]: node.startup = automatic
Oct 18 07:18:17 user nova-compute[74587]: node.leading_login = No
Oct 18 07:18:17 user nova-compute[74587]: iface.iscsi_ifacename = default
Oct 18 07:18:17 user nova-compute[74587]: iface.net_ifacename = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.ipaddress = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.prefix_len = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.hwaddress = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.transport_name = tcp
Oct 18 07:18:17 user nova-compute[74587]: iface.initiatorname = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.state = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.vlan_id = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.vlan_priority = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.vlan_state = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.iface_num = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.mtu = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.port = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.bootproto = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.subnet_mask = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.gateway = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.dhcp_alt_client_id_state = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.dhcp_alt_client_id = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.dhcp_dns = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.dhcp_learn_iqn = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.dhcp_req_vendor_id_state = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.dhcp_vendor_id_state = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.dhcp_vendor_id = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.dhcp_slp_da = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.fragmentation = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.gratuitous_arp = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.incoming_forwarding = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.tos_state = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.tos = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.ttl = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.delayed_ack = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.tcp_nagle = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.tcp_wsf_state = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.tcp_wsf = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.tcp_timer_scale = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.tcp_timestamp = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.redirect = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.def_task_mgmt_timeout = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.header_digest = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.data_digest = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.immediate_data = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.initial_r2t = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.data_seq_inorder = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.data_pdu_inorder = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.erl = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.max_receive_data_len = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.first_burst_len = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.max_outstanding_r2t = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.max_burst_len = 0
Oct 18 07:18:17 user nova-compute[74587]: iface.chap_auth = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.bidi_chap = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.strict_login_compliance = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.discovery_auth = <empty>
Oct 18 07:18:17 user nova-compute[74587]: iface.discovery_logout = <empty>
Oct 18 07:18:17 user nova-compute[74587]: node.discovery_address = <empty>
Oct 18 07:18:17 user nova-compute[74587]: node.discovery_port = 0
Oct 18 07:18:17 user nova-compute[74587]: node.discovery_type = static
Oct 18 07:18:17 user nova-compute[74587]: node.session.initial_cmdsn = 0
Oct 18 07:18:17 user nova-compute[74587]: node.session.initial_login_retry_max = 8
Oct 18 07:18:17 user nova-compute[74587]: node.session.xmit_thread_priority = -20
Oct 18 07:18:17 user nova-compute[74587]: node.session.cmds_max = 128
Oct 18 07:18:17 user nova-compute[74587]: node.session.queue_depth = 32
Oct 18 07:18:17 user nova-compute[74587]: node.session.nr_sessions = 1
Oct 18 07:18:17 user nova-compute[74587]: node.session.auth.authmethod = CHAP
Oct 18 07:18:17 user nova-compute[74587]: node.session.auth.username = anLrkbNy
Oct 18 07:18:17 user nova-compute[74587]: node.session.auth.password = ***
Oct 18 07:18:17 user nova-compute[74587]: node.session.auth.username_in = <empty>
Oct 18 07:18:17 user nova-compute[74587]: node.session.auth.password_in = <empty>
Oct 18 07:18:17 user nova-compute[74587]: node.session.auth.chap_algs = MD5
Oct 18 07:18:17 user nova-compute[74587]: node.session.timeo.replacement_timeout = 120
Oct 18 07:18:17 user nova-compute[74587]: node.session.err_timeo.abort_timeout = 15
Oct 18 07:18:17 user nova-compute[74587]: node.session.err_timeo.lu_reset_timeout = 30
Oct 18 07:18:17 user nova-compute[74587]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 18 07:18:17 user nova-compute[74587]: node.session.err_timeo.host_reset_timeout = 60
Oct 18 07:18:17 user nova-compute[74587]: node.session.iscsi.FastAbort = Yes
Oct 18 07:18:17 user nova-compute[74587]: node.session.iscsi.InitialR2T = No
Oct 18 07:18:17 user nova-compute[74587]: node.session.iscsi.ImmediateData = Yes
Oct 18 07:18:17 user nova-compute[74587]: node.session.iscsi.FirstBurstLength = 262144
Oct 18 07:18:17 user nova-compute[74587]: node.session.iscsi.MaxBurstLength = 16776192
Oct 18 07:18:17 user nova-compute[74587]: node.session.iscsi.DefaultTime2Retain = 0
Oct 18 07:18:17 user nova-compute[74587]: node.session.iscsi.DefaultTime2Wait = 2
Oct 18 07:18:17 user nova-compute[74587]: node.session.iscsi.MaxConnections = 1
Oct 18 07:18:17 user nova-compute[74587]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 18 07:18:17 user nova-compute[74587]: node.session.iscsi.ERL = 0
Oct 18 07:18:17 user nova-compute[74587]: node.session.scan = manual
Oct 18 07:18:17 user nova-compute[74587]: node.session.reopen_max = 0
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].address = 172.16.0.220
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].port = 3260
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].startup = manual
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].tcp.window_size = 524288
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].tcp.type_of_service = 0
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].timeo.logout_timeout = 15
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].timeo.login_timeout = 15
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].timeo.auth_timeout = 45
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].timeo.noop_out_interval = 5
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].timeo.noop_out_timeout = 5
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].iscsi.HeaderDigest = None
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].iscsi.DataDigest = None
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].iscsi.IFMarker = No
Oct 18 07:18:17 user nova-compute[74587]: node.conn[0].iscsi.OFMarker = No
Oct 18 07:18:17 user nova-compute[74587]: # END RECORD
Oct 18 07:18:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:17 user nova-compute[74587]: INFO os_vif [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1')
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e046b121-5303-4beb-9e17-fc6bb5f86778]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23c4c5b-a502-4c10-bf81-44bae21f3d16]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anLrkbNy {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anLrkbNy" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b852bc00-a2db-4d5d-a594-ab6f875ba3c4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'anLrkbNy'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No VIF found with MAC fa:16:3e:e4:25:0d, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f5658c-990e-4ddf-a4d4-b72653ecd68c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8408fb-e7e9-4149-97c3-70894dbef07d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:17 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:17 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:17 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:18:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:17 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:17 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:17 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:18:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.190s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] HCTL ('36', '0', '0', 0) found on session 21 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b756a3e2-68f7-43c2-97a5-499f971ce7ea]: (4, ('0 0 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Searching for a device in session 21 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anLrkbNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.223s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] <== connect_volume: return (224ms) {'type': 'block', 'scsi_wwn': '23466666366303266', 'path': '/dev/sde'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466666366303266', 'path': '/dev/sde'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1309022009',display_name='tempest-ServerStableDeviceRescueTest-server-1309022009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1309022009',id=15,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+HuSZvYMhTBndwoZFDitAG1bWKJbR8Y0n79KIgMy37m08QTWK7X7NI+1SBoM4Fp6cyZHsSfVTcL680PIULqCxeNPzGTuKFRiwq+1/7nMeuNZEWFCcHPbLRFiqo9+0Ing==',key_name='tempest-keypair-1438223812',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:14:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a14b181b13514ad18f0f72adafe71678',ramdisk_id='',reservation_id='r-itjbrbvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1119520504',owner_user_name='tempest-ServerStableDeviceRescueTest-1119520504-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:16:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc3f0fa71a254ce0857d37a232390e19',uuid=18ce6cb0-9632-4361-8d88-1b751e54ea71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "vif_mac": "fa:16:3e:db:3e:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Converting VIF {"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "vif_mac": "fa:16:3e:db:3e:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:3e:e9,bridge_name='br-int',has_traffic_filtering=True,id=63c9ec21-cedf-40fb-bb88-137fdb0ada25,network=Network(ef9dccd1-142a-452d-9252-573d6561e243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63c9ec21-ce') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'pci_devices' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.objects.base [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Object Instance<18ce6cb0-9632-4361-8d88-1b751e54ea71> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:18:17 user nova-compute[74587]:   <uuid>18ce6cb0-9632-4361-8d88-1b751e54ea71</uuid>
Oct 18 07:18:17 user nova-compute[74587]:   <name>instance-0000000f</name>
Oct 18 07:18:17 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:18:17 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:18:17 user nova-compute[74587]:   <metadata>
Oct 18 07:18:17 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:18:17 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1309022009</nova:name>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:18:17</nova:creationTime>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:18:17 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:18:17 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:owner>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:user uuid="cc3f0fa71a254ce0857d37a232390e19">tempest-ServerStableDeviceRescueTest-1119520504-project-member</nova:user>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:project uuid="a14b181b13514ad18f0f72adafe71678">tempest-ServerStableDeviceRescueTest-1119520504</nova:project>
Oct 18 07:18:17 user nova-compute[74587]:       </nova:owner>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:18:17 user nova-compute[74587]:       <nova:ports>
Oct 18 07:18:17 user nova-compute[74587]:         <nova:port uuid="63c9ec21-cedf-40fb-bb88-137fdb0ada25">
Oct 18 07:18:17 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:18:17 user nova-compute[74587]:         </nova:port>
Oct 18 07:18:17 user nova-compute[74587]:       </nova:ports>
Oct 18 07:18:17 user nova-compute[74587]:     </nova:instance>
Oct 18 07:18:17 user nova-compute[74587]:   </metadata>
Oct 18 07:18:17 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:18:17 user nova-compute[74587]:     <system>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="serial">18ce6cb0-9632-4361-8d88-1b751e54ea71</entry>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="uuid">18ce6cb0-9632-4361-8d88-1b751e54ea71</entry>
Oct 18 07:18:17 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:18:17 user nova-compute[74587]:     </system>
Oct 18 07:18:17 user nova-compute[74587]:   </sysinfo>
Oct 18 07:18:17 user nova-compute[74587]:   <os>
Oct 18 07:18:17 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:18:17 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:18:17 user nova-compute[74587]:   </os>
Oct 18 07:18:17 user nova-compute[74587]:   <features>
Oct 18 07:18:17 user nova-compute[74587]:     <acpi/>
Oct 18 07:18:17 user nova-compute[74587]:     <apic/>
Oct 18 07:18:17 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:18:17 user nova-compute[74587]:   </features>
Oct 18 07:18:17 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:18:17 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:18:17 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:18:17 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:18:17 user nova-compute[74587]:   </clock>
Oct 18 07:18:17 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:18:17 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:18:17 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:18:17 user nova-compute[74587]:   </cpu>
Oct 18 07:18:17 user nova-compute[74587]:   <devices>
Oct 18 07:18:17 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:18:17 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:18:17 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk"/>
Oct 18 07:18:17 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:18:17 user nova-compute[74587]:     </disk>
Oct 18 07:18:17 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:18:17 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:18:17 user nova-compute[74587]:       <source dev="/dev/sde"/>
Oct 18 07:18:17 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:18:17 user nova-compute[74587]:       <serial>e5e6656c-aaeb-46ff-855f-0427de81cb51</serial>
Oct 18 07:18:17 user nova-compute[74587]:     </disk>
Oct 18 07:18:17 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:18:17 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:18:17 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue"/>
Oct 18 07:18:17 user nova-compute[74587]:       <target dev="vdc" bus="virtio"/>
Oct 18 07:18:17 user nova-compute[74587]:       <boot order="1"/>
Oct 18 07:18:17 user nova-compute[74587]:     </disk>
Oct 18 07:18:17 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:18:17 user nova-compute[74587]:       <mac address="fa:16:3e:db:3e:e9"/>
Oct 18 07:18:17 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:18:17 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:18:17 user nova-compute[74587]:       <target dev="tap63c9ec21-ce"/>
Oct 18 07:18:17 user nova-compute[74587]:     </interface>
Oct 18 07:18:17 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:18:17 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/console.log" append="off"/>
Oct 18 07:18:17 user nova-compute[74587]:     </serial>
Oct 18 07:18:17 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:18:17 user nova-compute[74587]:     <video>
Oct 18 07:18:17 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:18:17 user nova-compute[74587]:     </video>
Oct 18 07:18:17 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:18:17 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:18:17 user nova-compute[74587]:     </rng>
Oct 18 07:18:17 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:18:17 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:18:17 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:18:17 user nova-compute[74587]:     </memballoon>
Oct 18 07:18:17 user nova-compute[74587]:   </devices>
Oct 18 07:18:17 user nova-compute[74587]: </domain>
Oct 18 07:18:17 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:18:17 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Instance destroyed successfully.
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.neutron [req-38ffd20d-6ca1-4458-b78a-eecc865a7e5c req-c28b90d9-7249-4a94-b681-b223a739007a service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Updated VIF entry in instance network info cache for port deba39b8-e178-4b6a-bf64-6b36d2980719. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG nova.network.neutron [req-38ffd20d-6ca1-4458-b78a-eecc865a7e5c req-c28b90d9-7249-4a94-b681-b223a739007a service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Updating instance_info_cache with network_info: [{"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:18:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-38ffd20d-6ca1-4458-b78a-eecc865a7e5c req-c28b90d9-7249-4a94-b681-b223a739007a service nova] Releasing lock "refresh_cache-57779903-c965-4099-b4fd-d934e02181dd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-8f1e962a-979e-4105-98c8-c36ba61feac3 req-6b13a990-59c2-423a-9bcc-da6cf3708304 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8f1e962a-979e-4105-98c8-c36ba61feac3 req-6b13a990-59c2-423a-9bcc-da6cf3708304 service nova] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8f1e962a-979e-4105-98c8-c36ba61feac3 req-6b13a990-59c2-423a-9bcc-da6cf3708304 service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8f1e962a-979e-4105-98c8-c36ba61feac3 req-6b13a990-59c2-423a-9bcc-da6cf3708304 service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-8f1e962a-979e-4105-98c8-c36ba61feac3 req-6b13a990-59c2-423a-9bcc-da6cf3708304 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] No waiting events found dispatching network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:19 user nova-compute[74587]: WARNING nova.compute.manager [req-8f1e962a-979e-4105-98c8-c36ba61feac3 req-6b13a990-59c2-423a-9bcc-da6cf3708304 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received unexpected event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 for instance with vm_state building and task_state spawning.
Oct 18 07:18:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] No VIF found with MAC fa:16:3e:db:3e:e9, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-d5964d7a-a140-4eaa-be7e-fce2df6e7e96 req-6c44a876-e3d6-40e8-9de7-acf7a1e41e27 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d5964d7a-a140-4eaa-be7e-fce2df6e7e96 req-6c44a876-e3d6-40e8-9de7-acf7a1e41e27 service nova] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d5964d7a-a140-4eaa-be7e-fce2df6e7e96 req-6c44a876-e3d6-40e8-9de7-acf7a1e41e27 service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d5964d7a-a140-4eaa-be7e-fce2df6e7e96 req-6c44a876-e3d6-40e8-9de7-acf7a1e41e27 service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-d5964d7a-a140-4eaa-be7e-fce2df6e7e96 req-6c44a876-e3d6-40e8-9de7-acf7a1e41e27 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] No waiting events found dispatching network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:21 user nova-compute[74587]: WARNING nova.compute.manager [req-d5964d7a-a140-4eaa-be7e-fce2df6e7e96 req-6c44a876-e3d6-40e8-9de7-acf7a1e41e27 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received unexpected event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 for instance with vm_state building and task_state spawning.
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:21 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Instance spawned successfully.
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-4da2c0e9-7828-41b2-aee0-99df516dbda7 req-1ed1444f-c55e-4c8c-a8d7-81c673cd782d service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4da2c0e9-7828-41b2-aee0-99df516dbda7 req-1ed1444f-c55e-4c8c-a8d7-81c673cd782d service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4da2c0e9-7828-41b2-aee0-99df516dbda7 req-1ed1444f-c55e-4c8c-a8d7-81c673cd782d service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4da2c0e9-7828-41b2-aee0-99df516dbda7 req-1ed1444f-c55e-4c8c-a8d7-81c673cd782d service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-4da2c0e9-7828-41b2-aee0-99df516dbda7 req-1ed1444f-c55e-4c8c-a8d7-81c673cd782d service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:21 user nova-compute[74587]: WARNING nova.compute.manager [req-4da2c0e9-7828-41b2-aee0-99df516dbda7 req-1ed1444f-c55e-4c8c-a8d7-81c673cd782d service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state active and task_state rescuing.
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue --force-share --output=json" returned: 0 in 0.314s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue --force-share --output=json" returned: 0 in 0.334s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:22 user nova-compute[74587]: INFO nova.compute.manager [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Took 7.37 seconds to spawn the instance on the hypervisor.
Oct 18 07:18:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:22 user nova-compute[74587]: INFO nova.compute.manager [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Took 8.68 seconds to build instance.
Oct 18 07:18:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6acf27cd-d050-45ef-b8bd-1d0bee7843a1 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.911s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-5ef85a73-c61f-4c3a-a1ad-0583f8c695df req-6ae18359-0b1c-461e-939e-df8949949f75 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5ef85a73-c61f-4c3a-a1ad-0583f8c695df req-6ae18359-0b1c-461e-939e-df8949949f75 service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5ef85a73-c61f-4c3a-a1ad-0583f8c695df req-6ae18359-0b1c-461e-939e-df8949949f75 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5ef85a73-c61f-4c3a-a1ad-0583f8c695df req-6ae18359-0b1c-461e-939e-df8949949f75 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-5ef85a73-c61f-4c3a-a1ad-0583f8c695df req-6ae18359-0b1c-461e-939e-df8949949f75 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:23 user nova-compute[74587]: WARNING nova.compute.manager [req-5ef85a73-c61f-4c3a-a1ad-0583f8c695df req-6ae18359-0b1c-461e-939e-df8949949f75 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state active and task_state rescuing.
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e51da3bb-ebf0-4153-9652-630b3f26d214 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:26 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:18:26 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=25.114471435546875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:18:26 user nova-compute[74587]: INFO nova.compute.manager [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] instance snapshotting
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance e82e7877-9569-4a62-9fff-48d4bcca3848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 7c0cae36-8828-4b06-aab2-29e38e6cfaf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee7e9ad7-fe94-4031-885c-ad134624135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 6875e226-7b26-4c33-a180-b08239799e69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 57779903-c965-4099-b4fd-d934e02181dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:18:26 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Beginning live snapshot process
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json -f qcow2 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json -f qcow2" returned: 0 in 0.216s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json -f qcow2 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:27 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:18:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json -f qcow2" returned: 0 in 0.208s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:27 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:18:27 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:18:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.952s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.227s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf_knwpmd/db4142621bdc431a9d19a9e19424d875.delta 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf_knwpmd/db4142621bdc431a9d19a9e19424d875.delta 1073741824" returned: 0 in 0.066s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:27 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 18 07:18:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:18:28 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:18:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] COPY block job progress, current cursor: 19857408 final cursor: 75497472 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:18:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:18:29 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 18 07:18:29 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:18:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf_knwpmd/db4142621bdc431a9d19a9e19424d875.delta /opt/stack/data/nova/instances/snapshots/tmpf_knwpmd/db4142621bdc431a9d19a9e19424d875 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf_knwpmd/db4142621bdc431a9d19a9e19424d875.delta /opt/stack/data/nova/instances/snapshots/tmpf_knwpmd/db4142621bdc431a9d19a9e19424d875" returned: 0 in 0.750s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Snapshot extracted, beginning image upload
Oct 18 07:18:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:33 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Snapshot image upload complete
Oct 18 07:18:33 user nova-compute[74587]: INFO nova.compute.manager [None req-24dd5585-7fe5-4f7a-8f46-588d16db2eb5 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Took 6.70 seconds to snapshot the instance on the hypervisor.
Oct 18 07:18:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXqpKsxw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:18:45 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:18:45 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:18:45 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9cab8b-c396-4e3e-80df-fc10c9d6034c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:18:45 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5130eb5-0673-4a67-aaff-48dc21ae4eba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75] added
Oct 18 07:18:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[74323635-2b9a-42dd-bcc6-a4348f5c4f03]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32b4b28-f4f9-41bd-bcd6-89846532afc4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXqpKsxw {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXqpKsxw" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3328de0-af36-4534-8dd1-6aa67d82d55b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jXqpKsxw'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dba33f-88eb-4396-9360-5a662ba16145]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad03c80-55ac-4323-a674-856c7686dfe4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9b365e-c5c2-47e8-bdad-371d6d06763e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75, portal: 172.16.0.220,3260]
Oct 18 07:18:45 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75, portal: 172.16.0.220,3260] successful.
Oct 18 07:18:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ae1039-fc9b-4eda-9bcd-b872ce50fd7d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[000e33b3-447d-4762-a7fa-f5edc8f7379e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 (non-flash)
Oct 18 07:18:45 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e27c065-6821-4559-9975-b1450d75094f]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:45 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:18:46 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:18:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXqpKsxw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:18:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:18:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26435613365386561', 'path': '/dev/sdf'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:18:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435613365386561', 'path': '/dev/sdf'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:18:46 user nova-compute[74587]: DEBUG nova.objects.instance [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lazy-loading 'flavor' on Instance uuid 7c0cae36-8828-4b06-aab2-29e38e6cfaf2 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:18:46 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:18:46 user nova-compute[74587]:   <source dev="/dev/sdf"/>
Oct 18 07:18:46 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:18:46 user nova-compute[74587]:   <serial>40b4b653-2245-468d-9ac0-5d66a2d7cc75</serial>
Oct 18 07:18:46 user nova-compute[74587]: </disk>
Oct 18 07:18:46 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:18:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:18:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] No VIF found with MAC fa:16:3e:80:e6:07, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:18:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cbe1d331-24be-4fa0-860c-9d2ba1c52d44 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 57.536s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:48 user nova-compute[74587]: INFO nova.compute.manager [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Terminating instance
Oct 18 07:18:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-3ff73855-1736-4537-817c-549135538223 req-dd547d1d-f6c5-457a-861d-790551f4ebe6 service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Received event network-vif-unplugged-a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3ff73855-1736-4537-817c-549135538223 req-dd547d1d-f6c5-457a-861d-790551f4ebe6 service nova] Acquiring lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3ff73855-1736-4537-817c-549135538223 req-dd547d1d-f6c5-457a-861d-790551f4ebe6 service nova] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3ff73855-1736-4537-817c-549135538223 req-dd547d1d-f6c5-457a-861d-790551f4ebe6 service nova] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-3ff73855-1736-4537-817c-549135538223 req-dd547d1d-f6c5-457a-861d-790551f4ebe6 service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] No waiting events found dispatching network-vif-unplugged-a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-3ff73855-1736-4537-817c-549135538223 req-dd547d1d-f6c5-457a-861d-790551f4ebe6 service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Received event network-vif-unplugged-a9391110-2f57-4403-a809-c67236563e58 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:18:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:49 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Instance destroyed successfully.
Oct 18 07:18:49 user nova-compute[74587]: DEBUG nova.objects.instance [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lazy-loading 'resources' on Instance uuid 7c0cae36-8828-4b06-aab2-29e38e6cfaf2 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-157737958',display_name='tempest-DeleteServersTestJSON-server-157737958',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-157737958',id=18,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc670d2091314f6489b707b188abd0db',ramdisk_id='',reservation_id='r-eoxsol1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1388448115',owner_user_name='tempest-DeleteServersTestJSON-1388448115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:16:02Z,user_data=None,user_id='0d37bad53eb04182bafeeca8ad5da945',uuid=7c0cae36-8828-4b06-aab2-29e38e6cfaf2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9391110-2f57-4403-a809-c67236563e58", "address": "fa:16:3e:80:e6:07", "network": {"id": "43146bcf-5895-4aba-80d6-3523809c34ce", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784326051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc670d2091314f6489b707b188abd0db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9391110-2f", "ovs_interfaceid": "a9391110-2f57-4403-a809-c67236563e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Converting VIF {"id": "a9391110-2f57-4403-a809-c67236563e58", "address": "fa:16:3e:80:e6:07", "network": {"id": "43146bcf-5895-4aba-80d6-3523809c34ce", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784326051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc670d2091314f6489b707b188abd0db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9391110-2f", "ovs_interfaceid": "a9391110-2f57-4403-a809-c67236563e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=a9391110-2f57-4403-a809-c67236563e58,network=Network(43146bcf-5895-4aba-80d6-3523809c34ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9391110-2f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_vif [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=a9391110-2f57-4403-a809-c67236563e58,network=Network(43146bcf-5895-4aba-80d6-3523809c34ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9391110-2f') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9391110-2f, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f11774e-b9bd-4548-ba47-bdfaa14297ba) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:18:49 user nova-compute[74587]: INFO os_vif [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=a9391110-2f57-4403-a809-c67236563e58,network=Network(43146bcf-5895-4aba-80d6-3523809c34ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9391110-2f')
Oct 18 07:18:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXqpKsxw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:18:49 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac9c842-c1ed-4eed-9d15-46a7cfd78342]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:18:49 user nova-compute[74587]: No targets found.
Oct 18 07:18:49 user nova-compute[74587]: iSNS:
Oct 18 07:18:49 user nova-compute[74587]: No targets found.
Oct 18 07:18:49 user nova-compute[74587]: STATIC:
Oct 18 07:18:49 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51
Oct 18 07:18:49 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:18:49 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:18:49 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75
Oct 18 07:18:49 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:18:49 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:18:49 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:18:49 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:18:49 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:18:49 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51
Oct 18 07:18:49 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:18:49 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:18:49 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3
Oct 18 07:18:49 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:18:49 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:18:49 user nova-compute[74587]: FIRMWARE:
Oct 18 07:18:49 user nova-compute[74587]: No targets found.
Oct 18 07:18:49 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:18:49 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:18:49 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[468ea31f-e487-4eef-b54b-d093128fc0ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[735377ee-e4f0-40d2-bab5-2b1c947e37bc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:49 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:49 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:49 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:18:49 user nova-compute[74587]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 (non-flash)
Oct 18 07:18:49 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:18:49 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:18:49 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:18:49 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:18:49 user nova-compute[74587]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 (non-flash)
Oct 18 07:18:49 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4505cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75'): ({'sdf'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Removing single pathed devices sdf {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbeea08-6c54-487e-b7bd-55d703b0f40d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e225224d-6289-4b4f-acd3-99ef4c7f3367]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Flushing IO for device /dev/sdf {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea8673-a55f-4310-93dd-ce0d34d4bc27]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed62770-3416-4e37-90b2-ebfb45543538]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] SCSI volumes sdf have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c3e9bb-3320-49a7-85fe-092f08e83fb9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e649933-8ad6-42fb-8214-4df6e4243868]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75, portal: 172.16.0.220,3260]
Oct 18 07:18:49 user nova-compute[74587]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75, portal: 172.16.0.220,3260] successful.
Oct 18 07:18:49 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b4b653-2245-468d-9ac0-5d66a2d7cc75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6056f478-d38c-43c4-8a04-de6a7c3ccdaf]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] <== disconnect_volume: return (322ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:18:49 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Deleting instance files /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2_del
Oct 18 07:18:49 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Deletion of /opt/stack/data/nova/instances/7c0cae36-8828-4b06-aab2-29e38e6cfaf2_del complete
Oct 18 07:18:49 user nova-compute[74587]: INFO nova.compute.manager [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 18 07:18:49 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:18:49 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:18:50 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:18:50 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Took 0.45 seconds to deallocate network for instance.
Oct 18 07:18:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-4f199779-f8d5-4820-85e7-f443d53e1599 req-433ad012-944d-4712-aded-d4c6bac4b84c service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Received event network-vif-deleted-a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-1f7d56a8-0d85-4a82-8cd8-45e1885a182a req-f25daacc-dc3d-4708-9108-8fe10bb24c3e service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Received event network-vif-plugged-a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:18:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1f7d56a8-0d85-4a82-8cd8-45e1885a182a req-f25daacc-dc3d-4708-9108-8fe10bb24c3e service nova] Acquiring lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1f7d56a8-0d85-4a82-8cd8-45e1885a182a req-f25daacc-dc3d-4708-9108-8fe10bb24c3e service nova] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1f7d56a8-0d85-4a82-8cd8-45e1885a182a req-f25daacc-dc3d-4708-9108-8fe10bb24c3e service nova] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-1f7d56a8-0d85-4a82-8cd8-45e1885a182a req-f25daacc-dc3d-4708-9108-8fe10bb24c3e service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] No waiting events found dispatching network-vif-plugged-a9391110-2f57-4403-a809-c67236563e58 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:18:50 user nova-compute[74587]: WARNING nova.compute.manager [req-1f7d56a8-0d85-4a82-8cd8-45e1885a182a req-f25daacc-dc3d-4708-9108-8fe10bb24c3e service nova] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Received unexpected event network-vif-plugged-a9391110-2f57-4403-a809-c67236563e58 for instance with vm_state active and task_state deleting.
Oct 18 07:18:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:51 user nova-compute[74587]: INFO nova.compute.manager [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Detaching volume 88a6bf44-a044-4ad4-886f-a8cad2d05f51
Oct 18 07:18:51 user nova-compute[74587]: INFO nova.virt.block_device [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Attempting to driver detach volume 88a6bf44-a044-4ad4-886f-a8cad2d05f51 from mountpoint /dev/vdc
Oct 18 07:18:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Attempting to detach device vdc from instance 6875e226-7b26-4c33-a180-b08239799e69 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:18:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:18:51 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:18:51 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:18:51 user nova-compute[74587]:   <target dev="vdc" bus="virtio"/>
Oct 18 07:18:51 user nova-compute[74587]:   <serial>88a6bf44-a044-4ad4-886f-a8cad2d05f51</serial>
Oct 18 07:18:51 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 07:18:51 user nova-compute[74587]: </disk>
Oct 18 07:18:51 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:18:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Successfully detached device vdc from instance 6875e226-7b26-4c33-a180-b08239799e69 from the persistent domain config.
Oct 18 07:18:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6875e226-7b26-4c33-a180-b08239799e69 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:18:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:18:51 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:18:51 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:18:51 user nova-compute[74587]:   <target dev="vdc" bus="virtio"/>
Oct 18 07:18:51 user nova-compute[74587]:   <serial>88a6bf44-a044-4ad4-886f-a8cad2d05f51</serial>
Oct 18 07:18:51 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 07:18:51 user nova-compute[74587]: </disk>
Oct 18 07:18:51 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:18:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:18:53 user nova-compute[74587]: INFO nova.compute.manager [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] [instance: 7c0cae36-8828-4b06-aab2-29e38e6cfaf2] Took 3.02 seconds to detach 1 volumes for instance.
Oct 18 07:18:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:18:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:18:53 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:18:53 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:18:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:53 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Deleted allocations for instance 7c0cae36-8828-4b06-aab2-29e38e6cfaf2
Oct 18 07:18:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-abf4d887-8f3e-4b0d-995e-4a0807a24a66 tempest-DeleteServersTestJSON-1388448115 tempest-DeleteServersTestJSON-1388448115-project-member] Lock "7c0cae36-8828-4b06-aab2-29e38e6cfaf2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.400s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:18:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:18:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:19:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:19:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:19:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:19:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:09 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:19:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:19:12 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6875e226-7b26-4c33-a180-b08239799e69 is timed out.
Oct 18 07:19:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Successfully detached device vdc from instance 6875e226-7b26-4c33-a180-b08239799e69 from the live domain config.
Oct 18 07:19:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVRaBhHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:19:12 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d27a226-2ebc-4c94-bffb-083d367dc75b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:19:12 user nova-compute[74587]: No targets found.
Oct 18 07:19:12 user nova-compute[74587]: iSNS:
Oct 18 07:19:12 user nova-compute[74587]: No targets found.
Oct 18 07:19:12 user nova-compute[74587]: STATIC:
Oct 18 07:19:12 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51
Oct 18 07:19:12 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:19:12 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:19:12 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:19:12 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:19:12 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:19:12 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51
Oct 18 07:19:12 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:19:12 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:19:12 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3
Oct 18 07:19:12 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:19:12 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:19:12 user nova-compute[74587]: FIRMWARE:
Oct 18 07:19:12 user nova-compute[74587]: No targets found.
Oct 18 07:19:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:19:12 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:19:12 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6cea62-a136-425b-a064-37e9c1bab89d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d02424a-610a-4a2e-8600-6ab3932ef299]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:19:12 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:19:12 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:19:12 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:19:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:19:12 user nova-compute[74587]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 (non-flash)
Oct 18 07:19:12 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:19:12 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:19:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe45b6cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[70954d26-4e9b-4461-8f7f-c39f023e5465]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dba00ea-2aaa-4b7c-a1cc-58f404c553bd]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61cd1c2-0207-412c-9279-262f298dcd16]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98b4ba-a7a1-40a3-b42b-0d907c6637fb]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ee576-91fb-424d-af40-b2c7145c2fa7]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cbab75-3d65-4293-98e4-51850405dbb7]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51, portal: 172.16.0.220,3260]
Oct 18 07:19:12 user nova-compute[74587]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51, portal: 172.16.0.220,3260] successful.
Oct 18 07:19:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a6bf44-a044-4ad4-886f-a8cad2d05f51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[074edcad-d30d-425f-943e-e63e396ddf16]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] <== disconnect_volume: return (302ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:19:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG nova.objects.instance [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'flavor' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-12677ad8-141b-4429-88e1-3f29b8f264ce tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.820s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updating instance_info_cache with network_info: [{"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-0d568195-c89b-47e8-9992-bfc3a6c8e929" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:19:13 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:19:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:19:15 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:19:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:19:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:19:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:19:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:19:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:19:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:22 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:19:22 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7510MB free_disk=25.052894592285156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance e82e7877-9569-4a62-9fff-48d4bcca3848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee7e9ad7-fe94-4031-885c-ad134624135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 6875e226-7b26-4c33-a180-b08239799e69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 57779903-c965-4099-b4fd-d934e02181dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:19:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:19:23 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:19:23 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:19:23 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:19:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:19:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:19:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-ce1420ca-d30a-4d7d-8913-a5e809c5e367 req-5f8e6717-3314-44fd-bacf-324198e9a19f service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received event network-changed-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:19:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-ce1420ca-d30a-4d7d-8913-a5e809c5e367 req-5f8e6717-3314-44fd-bacf-324198e9a19f service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Refreshing instance network info cache due to event network-changed-5943d9a8-1bde-4fec-809b-c2887cf98dc6. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:19:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ce1420ca-d30a-4d7d-8913-a5e809c5e367 req-5f8e6717-3314-44fd-bacf-324198e9a19f service nova] Acquiring lock "refresh_cache-b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:19:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ce1420ca-d30a-4d7d-8913-a5e809c5e367 req-5f8e6717-3314-44fd-bacf-324198e9a19f service nova] Acquired lock "refresh_cache-b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:19:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-ce1420ca-d30a-4d7d-8913-a5e809c5e367 req-5f8e6717-3314-44fd-bacf-324198e9a19f service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Refreshing network info cache for port 5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:19:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-ce1420ca-d30a-4d7d-8913-a5e809c5e367 req-5f8e6717-3314-44fd-bacf-324198e9a19f service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Updated VIF entry in instance network info cache for port 5943d9a8-1bde-4fec-809b-c2887cf98dc6. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:19:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-ce1420ca-d30a-4d7d-8913-a5e809c5e367 req-5f8e6717-3314-44fd-bacf-324198e9a19f service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Updating instance_info_cache with network_info: [{"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:19:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ce1420ca-d30a-4d7d-8913-a5e809c5e367 req-5f8e6717-3314-44fd-bacf-324198e9a19f service nova] Releasing lock "refresh_cache-b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:19:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:19:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'flavor' on Instance uuid b1c2c7fb-7f42-49df-9d7b-706dffa5a6db {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:33 user nova-compute[74587]: INFO nova.compute.manager [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Attaching volume f6534655-a00b-4812-975a-7f07f677f77f to /dev/vdb
Oct 18 07:19:33 user nova-compute[74587]: DEBUG os_brick.utils [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba18cd3-c21e-4cad-93f4-53671dc30813]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6044cc40-c815-4cc8-943b-f3b761e7323c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1afb102-4b65-4045-9101-2796ce195b97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f30a30-f68a-4ccf-a513-f393cd46985a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:19:33 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:19:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d61b878-e004-4adf-9251-8abce66a6599]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG os_brick.utils [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:19:33 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Updating existing volume attachment record: bf4fd004-d085-4ad0-92c3-f2404c53b58a {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:19:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:19:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:19:34 user nova-compute[74587]: INFO nova.compute.claims [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Claim successful on node user
Oct 18 07:19:35 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:19:35 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:19:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:19:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:19:35 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:19:35 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:19:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:19:35 user nova-compute[74587]: DEBUG nova.policy [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2ca09ce37384d25931eb9a658384255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c002a125aec54fa388965a9f83cc1624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:19:35 user nova-compute[74587]: INFO nova.virt.block_device [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Booting with volume-backed-image 9442f4c2-6355-454c-90aa-9dccf102d343 at /dev/vda
Oct 18 07:19:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:36 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Successfully created port: ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:19:36 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Successfully updated port: ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:19:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:19:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquired lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:19:36 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:19:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-573f8f5b-ad27-40cf-b52c-cb484c2d2594 req-c2c43e1d-ebe4-4721-9e29-fcff083daecf service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-changed-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:19:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-573f8f5b-ad27-40cf-b52c-cb484c2d2594 req-c2c43e1d-ebe4-4721-9e29-fcff083daecf service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Refreshing instance network info cache due to event network-changed-ae030258-2fea-414a-9e11-2db1da2515f4. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:19:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-573f8f5b-ad27-40cf-b52c-cb484c2d2594 req-c2c43e1d-ebe4-4721-9e29-fcff083daecf service nova] Acquiring lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:19:36 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:19:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:37 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Updating instance_info_cache with network_info: [{"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:19:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Releasing lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:19:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Instance network_info: |[{"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:19:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-573f8f5b-ad27-40cf-b52c-cb484c2d2594 req-c2c43e1d-ebe4-4721-9e29-fcff083daecf service nova] Acquired lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:19:37 user nova-compute[74587]: DEBUG nova.network.neutron [req-573f8f5b-ad27-40cf-b52c-cb484c2d2594 req-c2c43e1d-ebe4-4721-9e29-fcff083daecf service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Refreshing network info cache for port ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:19:37 user nova-compute[74587]: DEBUG nova.network.neutron [req-573f8f5b-ad27-40cf-b52c-cb484c2d2594 req-c2c43e1d-ebe4-4721-9e29-fcff083daecf service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Updated VIF entry in instance network info cache for port ae030258-2fea-414a-9e11-2db1da2515f4. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:19:37 user nova-compute[74587]: DEBUG nova.network.neutron [req-573f8f5b-ad27-40cf-b52c-cb484c2d2594 req-c2c43e1d-ebe4-4721-9e29-fcff083daecf service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Updating instance_info_cache with network_info: [{"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:19:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-573f8f5b-ad27-40cf-b52c-cb484c2d2594 req-c2c43e1d-ebe4-4721-9e29-fcff083daecf service nova] Releasing lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:19:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:41 user nova-compute[74587]: INFO nova.compute.manager [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Terminating instance
Oct 18 07:19:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-6e8a7d3e-17c3-4e90-9fe1-bd9e342cd2c8 req-c7153f90-adda-4d1a-8158-a9835c7639f0 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-vif-unplugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6e8a7d3e-17c3-4e90-9fe1-bd9e342cd2c8 req-c7153f90-adda-4d1a-8158-a9835c7639f0 service nova] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6e8a7d3e-17c3-4e90-9fe1-bd9e342cd2c8 req-c7153f90-adda-4d1a-8158-a9835c7639f0 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6e8a7d3e-17c3-4e90-9fe1-bd9e342cd2c8 req-c7153f90-adda-4d1a-8158-a9835c7639f0 service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-6e8a7d3e-17c3-4e90-9fe1-bd9e342cd2c8 req-c7153f90-adda-4d1a-8158-a9835c7639f0 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] No waiting events found dispatching network-vif-unplugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-6e8a7d3e-17c3-4e90-9fe1-bd9e342cd2c8 req-c7153f90-adda-4d1a-8158-a9835c7639f0 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-vif-unplugged-6059c685-1a4c-4810-b1ce-e215a3d5480e for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:19:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Instance destroyed successfully.
Oct 18 07:19:42 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'resources' on Instance uuid 6875e226-7b26-4c33-a180-b08239799e69 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2069033531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2069033531',id=14,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2OCCzPMYKDOEUcsgfvQkCHiXxHUwNUQgB8nvUOb5VxRH/UDpQql6ChMd2+OQjXVatvUxAEl3E51L40GHaC4nhOvPlFTYlcvWZMYw9OWt/SMLgdjsX02bLIWctv4g338Q==',key_name='tempest-keypair-1908131829',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:17:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-rrzz9okk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=6875e226-7b26-4c33-a180-b08239799e69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "address": "fa:16:3e:72:97:53", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6059c685-1a", "ovs_interfaceid": "6059c685-1a4c-4810-b1ce-e215a3d5480e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG os_vif [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6059c685-1a, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d322959-13c4-4d14-a630-23e6139d485a) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:42 user nova-compute[74587]: INFO os_vif [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:97:53,bridge_name='br-int',has_traffic_filtering=True,id=6059c685-1a4c-4810-b1ce-e215a3d5480e,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6059c685-1a')
Oct 18 07:19:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Deleting instance files /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69_del
Oct 18 07:19:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Deletion of /opt/stack/data/nova/instances/6875e226-7b26-4c33-a180-b08239799e69_del complete
Oct 18 07:19:42 user nova-compute[74587]: INFO nova.compute.manager [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 18 07:19:42 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:19:42 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 6875e226-7b26-4c33-a180-b08239799e69] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:19:43 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:19:43 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Took 0.70 seconds to deallocate network for instance.
Oct 18 07:19:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-1b2e9e11-4f6e-4a8a-b6a0-896aabde72bc req-646d6d11-5add-49be-95b2-345c609841b0 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-vif-deleted-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:19:43 user nova-compute[74587]: INFO nova.compute.manager [req-1b2e9e11-4f6e-4a8a-b6a0-896aabde72bc req-646d6d11-5add-49be-95b2-345c609841b0 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Neutron deleted interface 6059c685-1a4c-4810-b1ce-e215a3d5480e; detaching it from the instance and deleting it from the info cache
Oct 18 07:19:43 user nova-compute[74587]: DEBUG nova.network.neutron [req-1b2e9e11-4f6e-4a8a-b6a0-896aabde72bc req-646d6d11-5add-49be-95b2-345c609841b0 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:19:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-1b2e9e11-4f6e-4a8a-b6a0-896aabde72bc req-646d6d11-5add-49be-95b2-345c609841b0 service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Detach interface failed, port_id=6059c685-1a4c-4810-b1ce-e215a3d5480e, reason: Instance 6875e226-7b26-4c33-a180-b08239799e69 could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:19:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:44 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:19:44 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:19:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:44 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Deleted allocations for instance 6875e226-7b26-4c33-a180-b08239799e69
Oct 18 07:19:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e3b95f7-ed7a-4799-b965-f1b9587586c0 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "6875e226-7b26-4c33-a180-b08239799e69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-69a9bccf-9b68-4d7b-a156-ce59f3d9d521 req-8f659f2f-1693-4e81-9a27-195be23d696c service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:19:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69a9bccf-9b68-4d7b-a156-ce59f3d9d521 req-8f659f2f-1693-4e81-9a27-195be23d696c service nova] Acquiring lock "6875e226-7b26-4c33-a180-b08239799e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69a9bccf-9b68-4d7b-a156-ce59f3d9d521 req-8f659f2f-1693-4e81-9a27-195be23d696c service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69a9bccf-9b68-4d7b-a156-ce59f3d9d521 req-8f659f2f-1693-4e81-9a27-195be23d696c service nova] Lock "6875e226-7b26-4c33-a180-b08239799e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-69a9bccf-9b68-4d7b-a156-ce59f3d9d521 req-8f659f2f-1693-4e81-9a27-195be23d696c service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] No waiting events found dispatching network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:19:44 user nova-compute[74587]: WARNING nova.compute.manager [req-69a9bccf-9b68-4d7b-a156-ce59f3d9d521 req-8f659f2f-1693-4e81-9a27-195be23d696c service nova] [instance: 6875e226-7b26-4c33-a180-b08239799e69] Received unexpected event network-vif-plugged-6059c685-1a4c-4810-b1ce-e215a3d5480e for instance with vm_state deleted and task_state None.
Oct 18 07:19:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nivrjKmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:19:51 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:19:51 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:19:51 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33020a7-2c32-41fb-9457-09e2689ec09c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:19:51 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cc0c38-c1cf-44f7-9acb-21661a52e010]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f] added
Oct 18 07:19:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[555e8ff5-f88f-4672-ba4c-54ecd7255dab]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a579354a-7782-45c0-a8bd-5246beb9b57f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nivrjKmq {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nivrjKmq" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe35fca-04a4-41c6-a908-7d620d2c5ad8]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nivrjKmq'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c51b68-18fe-4827-b412-1aab2adafee4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12977d9-424c-4f50-b54c-88a5474316f4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:19:51 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:19:51 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:19:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:19:51 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:19:51 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:19:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1eae2d-d641-46e6-8b36-19ba3b9e3249]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f, portal: 172.16.0.220,3260]
Oct 18 07:19:51 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f, portal: 172.16.0.220,3260] successful.
Oct 18 07:19:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb46addf-0201-45c9-a26b-d13d00631763]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2c38f6-bd38-46ef-8984-355a56ff35b9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:19:51 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:19:51 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:19:51 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:19:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:19:51 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:19:51 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:19:51 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:19:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.utils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ed290-4829-4144-9dae-1b27864bd597]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nivrjKmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d5a14-a431-47ab-b4b7-926f2a727589]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bdfc6d-eeb3-4981-b4fc-037bc25006ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75cb16a-818e-4533-82ac-d15a5e7fb5fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d16a204-0d3b-4321-9db5-399e99e31ebb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:19:51 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:19:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3d25b5-b06f-4d7c-8783-fa47b2aa9946]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG os_brick.utils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:19:51 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Updating existing volume attachment record: 8d534e75-9099-4eac-aded-fca69ece9e75 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:19:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:19:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23336663036393936', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:19:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336663036393936', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:19:52 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'flavor' on Instance uuid b1c2c7fb-7f42-49df-9d7b-706dffa5a6db {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:19:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:19:52 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:19:52 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:19:52 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:19:52 user nova-compute[74587]:   <serial>f6534655-a00b-4812-975a-7f07f677f77f</serial>
Oct 18 07:19:52 user nova-compute[74587]: </disk>
Oct 18 07:19:52 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:19:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:19:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:19:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No VIF found with MAC fa:16:3e:81:1c:3e, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:19:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e2124c7a-2c0b-4bcf-8131-feeb641b851c tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.749s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:56 user nova-compute[74587]: DEBUG nova.compute.manager [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:19:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:19:56 user nova-compute[74587]: INFO nova.compute.claims [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Claim successful on node user
Oct 18 07:19:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:56 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:19:56 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:19:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:56 user nova-compute[74587]: DEBUG nova.compute.manager [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG nova.network.neutron [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:19:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:19:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG nova.policy [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aceede4662a4aaa92c79dfd538effea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc0eafb55fd4673a3d8fcb0e63602c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:19:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Creating image(s)
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "/opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "/opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "/opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.184s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.214s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk 1073741824" returned: 0 in 0.056s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG nova.network.neutron [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Successfully created port: 0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:19:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Cannot resize image /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Ensure instance console log exists: /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Successfully updated port: 0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "refresh_cache-5313fc03-fe27-471c-b0b1-ae9806bbe2a7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquired lock "refresh_cache-5313fc03-fe27-471c-b0b1-ae9806bbe2a7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-a2c3886d-6bb7-4794-8849-52bfe7d196ab req-f2aeee61-7c19-4c2e-8861-5e955f2e9fc8 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received event network-changed-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-a2c3886d-6bb7-4794-8849-52bfe7d196ab req-f2aeee61-7c19-4c2e-8861-5e955f2e9fc8 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Refreshing instance network info cache due to event network-changed-0b48f003-8e96-46fd-baf0-ccdee461947b. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a2c3886d-6bb7-4794-8849-52bfe7d196ab req-f2aeee61-7c19-4c2e-8861-5e955f2e9fc8 service nova] Acquiring lock "refresh_cache-5313fc03-fe27-471c-b0b1-ae9806bbe2a7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Updating instance_info_cache with network_info: [{"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Releasing lock "refresh_cache-5313fc03-fe27-471c-b0b1-ae9806bbe2a7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Instance network_info: |[{"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a2c3886d-6bb7-4794-8849-52bfe7d196ab req-f2aeee61-7c19-4c2e-8861-5e955f2e9fc8 service nova] Acquired lock "refresh_cache-5313fc03-fe27-471c-b0b1-ae9806bbe2a7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.network.neutron [req-a2c3886d-6bb7-4794-8849-52bfe7d196ab req-f2aeee61-7c19-4c2e-8861-5e955f2e9fc8 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Refreshing network info cache for port 0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Start _get_guest_xml network_info=[{"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:19:58 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:19:58 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-246226713',display_name='tempest-AttachVolumeNegativeTest-server-246226713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-246226713',id=23,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgR3fa5HNp8w+jVYMBAaR91VwT8vhIUoI/tfzniGMTxu3TbxaHhAVFvkl1YPhLGE4JhkEI2MlUuG7K5oK/GeGdIRRALAwzutY6jndOZXn7+VrqdYlnL9gq3z80WnGOy7Q==',key_name='tempest-keypair-1121727041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-ot745wlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:19:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=5313fc03-fe27-471c-b0b1-ae9806bbe2a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e4:f7,bridge_name='br-int',has_traffic_filtering=True,id=0b48f003-8e96-46fd-baf0-ccdee461947b,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48f003-8e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.objects.instance [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'pci_devices' on Instance uuid 5313fc03-fe27-471c-b0b1-ae9806bbe2a7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:19:58 user nova-compute[74587]:   <uuid>5313fc03-fe27-471c-b0b1-ae9806bbe2a7</uuid>
Oct 18 07:19:58 user nova-compute[74587]:   <name>instance-00000017</name>
Oct 18 07:19:58 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:19:58 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:19:58 user nova-compute[74587]:   <metadata>
Oct 18 07:19:58 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:19:58 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:19:58 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeNegativeTest-server-246226713</nova:name>
Oct 18 07:19:58 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:19:58</nova:creationTime>
Oct 18 07:19:58 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:19:58 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:19:58 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:19:58 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:19:58 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:19:58 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:19:58 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:19:58 user nova-compute[74587]:       <nova:owner>
Oct 18 07:19:58 user nova-compute[74587]:         <nova:user uuid="8aceede4662a4aaa92c79dfd538effea">tempest-AttachVolumeNegativeTest-859195449-project-member</nova:user>
Oct 18 07:19:58 user nova-compute[74587]:         <nova:project uuid="0cc0eafb55fd4673a3d8fcb0e63602c7">tempest-AttachVolumeNegativeTest-859195449</nova:project>
Oct 18 07:19:58 user nova-compute[74587]:       </nova:owner>
Oct 18 07:19:58 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:19:58 user nova-compute[74587]:       <nova:ports>
Oct 18 07:19:58 user nova-compute[74587]:         <nova:port uuid="0b48f003-8e96-46fd-baf0-ccdee461947b">
Oct 18 07:19:58 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 07:19:58 user nova-compute[74587]:         </nova:port>
Oct 18 07:19:58 user nova-compute[74587]:       </nova:ports>
Oct 18 07:19:58 user nova-compute[74587]:     </nova:instance>
Oct 18 07:19:58 user nova-compute[74587]:   </metadata>
Oct 18 07:19:58 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:19:58 user nova-compute[74587]:     <system>
Oct 18 07:19:58 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:19:58 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:19:58 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:19:58 user nova-compute[74587]:       <entry name="serial">5313fc03-fe27-471c-b0b1-ae9806bbe2a7</entry>
Oct 18 07:19:58 user nova-compute[74587]:       <entry name="uuid">5313fc03-fe27-471c-b0b1-ae9806bbe2a7</entry>
Oct 18 07:19:58 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:19:58 user nova-compute[74587]:     </system>
Oct 18 07:19:58 user nova-compute[74587]:   </sysinfo>
Oct 18 07:19:58 user nova-compute[74587]:   <os>
Oct 18 07:19:58 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:19:58 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:19:58 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:19:58 user nova-compute[74587]:   </os>
Oct 18 07:19:58 user nova-compute[74587]:   <features>
Oct 18 07:19:58 user nova-compute[74587]:     <acpi/>
Oct 18 07:19:58 user nova-compute[74587]:     <apic/>
Oct 18 07:19:58 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:19:58 user nova-compute[74587]:   </features>
Oct 18 07:19:58 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:19:58 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:19:58 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:19:58 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:19:58 user nova-compute[74587]:   </clock>
Oct 18 07:19:58 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:19:58 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:19:58 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:19:58 user nova-compute[74587]:   </cpu>
Oct 18 07:19:58 user nova-compute[74587]:   <devices>
Oct 18 07:19:58 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:19:58 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:19:58 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk"/>
Oct 18 07:19:58 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:19:58 user nova-compute[74587]:     </disk>
Oct 18 07:19:58 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:19:58 user nova-compute[74587]:       <mac address="fa:16:3e:2c:e4:f7"/>
Oct 18 07:19:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:19:58 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:19:58 user nova-compute[74587]:       <target dev="tap0b48f003-8e"/>
Oct 18 07:19:58 user nova-compute[74587]:     </interface>
Oct 18 07:19:58 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:19:58 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/console.log" append="off"/>
Oct 18 07:19:58 user nova-compute[74587]:     </serial>
Oct 18 07:19:58 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:19:58 user nova-compute[74587]:     <video>
Oct 18 07:19:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:19:58 user nova-compute[74587]:     </video>
Oct 18 07:19:58 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:19:58 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:19:58 user nova-compute[74587]:     </rng>
Oct 18 07:19:58 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:19:58 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:19:58 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:19:58 user nova-compute[74587]:     </memballoon>
Oct 18 07:19:58 user nova-compute[74587]:   </devices>
Oct 18 07:19:58 user nova-compute[74587]: </domain>
Oct 18 07:19:58 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-246226713',display_name='tempest-AttachVolumeNegativeTest-server-246226713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-246226713',id=23,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgR3fa5HNp8w+jVYMBAaR91VwT8vhIUoI/tfzniGMTxu3TbxaHhAVFvkl1YPhLGE4JhkEI2MlUuG7K5oK/GeGdIRRALAwzutY6jndOZXn7+VrqdYlnL9gq3z80WnGOy7Q==',key_name='tempest-keypair-1121727041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-ot745wlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:19:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=5313fc03-fe27-471c-b0b1-ae9806bbe2a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e4:f7,bridge_name='br-int',has_traffic_filtering=True,id=0b48f003-8e96-46fd-baf0-ccdee461947b,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48f003-8e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG os_vif [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e4:f7,bridge_name='br-int',has_traffic_filtering=True,id=0b48f003-8e96-46fd-baf0-ccdee461947b,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48f003-8e') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5819d55-98ab-532b-89d5-3afd3e94aacc', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b48f003-8e, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b48f003-8e, col_values=(('qos', UUID('1bd3d9c4-7d60-48ae-91e9-3cc48d31cd27')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b48f003-8e, col_values=(('external_ids', {'iface-id': '0b48f003-8e96-46fd-baf0-ccdee461947b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:e4:f7', 'vm-uuid': '5313fc03-fe27-471c-b0b1-ae9806bbe2a7'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:19:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:19:58 user nova-compute[74587]: INFO os_vif [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e4:f7,bridge_name='br-int',has_traffic_filtering=True,id=0b48f003-8e96-46fd-baf0-ccdee461947b,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48f003-8e')
Oct 18 07:19:59 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:19:59 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No VIF found with MAC fa:16:3e:2c:e4:f7, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:19:59 user nova-compute[74587]: DEBUG nova.network.neutron [req-a2c3886d-6bb7-4794-8849-52bfe7d196ab req-f2aeee61-7c19-4c2e-8861-5e955f2e9fc8 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Updated VIF entry in instance network info cache for port 0b48f003-8e96-46fd-baf0-ccdee461947b. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:19:59 user nova-compute[74587]: DEBUG nova.network.neutron [req-a2c3886d-6bb7-4794-8849-52bfe7d196ab req-f2aeee61-7c19-4c2e-8861-5e955f2e9fc8 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Updating instance_info_cache with network_info: [{"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:19:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a2c3886d-6bb7-4794-8849-52bfe7d196ab req-f2aeee61-7c19-4c2e-8861-5e955f2e9fc8 service nova] Releasing lock "refresh_cache-5313fc03-fe27-471c-b0b1-ae9806bbe2a7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-3c16e369-2150-4758-85c1-b7d54041b576 req-9dc5da10-5781-483e-bf46-914e6796a102 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received event network-vif-plugged-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3c16e369-2150-4758-85c1-b7d54041b576 req-9dc5da10-5781-483e-bf46-914e6796a102 service nova] Acquiring lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3c16e369-2150-4758-85c1-b7d54041b576 req-9dc5da10-5781-483e-bf46-914e6796a102 service nova] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3c16e369-2150-4758-85c1-b7d54041b576 req-9dc5da10-5781-483e-bf46-914e6796a102 service nova] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-3c16e369-2150-4758-85c1-b7d54041b576 req-9dc5da10-5781-483e-bf46-914e6796a102 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] No waiting events found dispatching network-vif-plugged-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:00 user nova-compute[74587]: WARNING nova.compute.manager [req-3c16e369-2150-4758-85c1-b7d54041b576 req-9dc5da10-5781-483e-bf46-914e6796a102 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received unexpected event network-vif-plugged-0b48f003-8e96-46fd-baf0-ccdee461947b for instance with vm_state building and task_state spawning.
Oct 18 07:20:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:02 user nova-compute[74587]: INFO nova.compute.manager [None req-cb5edd3a-5913-4809-b78a-227430b10438 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Unrescuing
Oct 18 07:20:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cb5edd3a-5913-4809-b78a-227430b10438 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cb5edd3a-5913-4809-b78a-227430b10438 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquired lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-cb5edd3a-5913-4809-b78a-227430b10438 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-1918f580-5a14-41d3-a358-2c9da80a8936 req-49c99428-2fa7-47c0-9f9a-e7a05373fced service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received event network-vif-plugged-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1918f580-5a14-41d3-a358-2c9da80a8936 req-49c99428-2fa7-47c0-9f9a-e7a05373fced service nova] Acquiring lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1918f580-5a14-41d3-a358-2c9da80a8936 req-49c99428-2fa7-47c0-9f9a-e7a05373fced service nova] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1918f580-5a14-41d3-a358-2c9da80a8936 req-49c99428-2fa7-47c0-9f9a-e7a05373fced service nova] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-1918f580-5a14-41d3-a358-2c9da80a8936 req-49c99428-2fa7-47c0-9f9a-e7a05373fced service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] No waiting events found dispatching network-vif-plugged-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:02 user nova-compute[74587]: WARNING nova.compute.manager [req-1918f580-5a14-41d3-a358-2c9da80a8936 req-49c99428-2fa7-47c0-9f9a-e7a05373fced service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received unexpected event network-vif-plugged-0b48f003-8e96-46fd-baf0-ccdee461947b for instance with vm_state building and task_state spawning.
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-cb5edd3a-5913-4809-b78a-227430b10438 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updating instance_info_cache with network_info: [{"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cb5edd3a-5913-4809-b78a-227430b10438 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Releasing lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.objects.instance [None req-cb5edd3a-5913-4809-b78a-227430b10438 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'flavor' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:20:02 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Instance spawned successfully.
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:02 user nova-compute[74587]: INFO nova.compute.manager [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Took 5.62 seconds to spawn the instance on the hypervisor.
Oct 18 07:20:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:20:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:03 user nova-compute[74587]: INFO nova.compute.manager [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Took 6.64 seconds to build instance.
Oct 18 07:20:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-21f691b1-ce84-4e41-a92c-8a7e8f8be875 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.746s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:03 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Instance destroyed successfully.
Oct 18 07:20:03 user nova-compute[74587]: INFO nova.compute.manager [None req-b4fc3285-5e7a-4e21-b47d-2062af77b0ab tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Unrescuing
Oct 18 07:20:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b4fc3285-5e7a-4e21-b47d-2062af77b0ab tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b4fc3285-5e7a-4e21-b47d-2062af77b0ab tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquired lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b4fc3285-5e7a-4e21-b47d-2062af77b0ab tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:20:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:04 user nova-compute[74587]: DEBUG nova.network.neutron [None req-b4fc3285-5e7a-4e21-b47d-2062af77b0ab tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updating instance_info_cache with network_info: [{"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b4fc3285-5e7a-4e21-b47d-2062af77b0ab tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Releasing lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:04 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b4fc3285-5e7a-4e21-b47d-2062af77b0ab tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'flavor' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:20:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-1b7b929e-8603-4ca4-863e-775c46e14124 req-66748b2c-09a7-4daa-ab36-8c5413121d50 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-changed-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-1b7b929e-8603-4ca4-863e-775c46e14124 req-66748b2c-09a7-4daa-ab36-8c5413121d50 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Refreshing instance network info cache due to event network-changed-deba39b8-e178-4b6a-bf64-6b36d2980719. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1b7b929e-8603-4ca4-863e-775c46e14124 req-66748b2c-09a7-4daa-ab36-8c5413121d50 service nova] Acquiring lock "refresh_cache-57779903-c965-4099-b4fd-d934e02181dd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1b7b929e-8603-4ca4-863e-775c46e14124 req-66748b2c-09a7-4daa-ab36-8c5413121d50 service nova] Acquired lock "refresh_cache-57779903-c965-4099-b4fd-d934e02181dd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.network.neutron [req-1b7b929e-8603-4ca4-863e-775c46e14124 req-66748b2c-09a7-4daa-ab36-8c5413121d50 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Refreshing network info cache for port deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-972a35e0-815d-468e-9080-7aeb222f4156 req-4a01d718-ecf7-49a1-aeec-261b3cfb2a62 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-changed-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-972a35e0-815d-468e-9080-7aeb222f4156 req-4a01d718-ecf7-49a1-aeec-261b3cfb2a62 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Refreshing instance network info cache due to event network-changed-63c9ec21-cedf-40fb-bb88-137fdb0ada25. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-972a35e0-815d-468e-9080-7aeb222f4156 req-4a01d718-ecf7-49a1-aeec-261b3cfb2a62 service nova] Acquiring lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-972a35e0-815d-468e-9080-7aeb222f4156 req-4a01d718-ecf7-49a1-aeec-261b3cfb2a62 service nova] Acquired lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.network.neutron [req-972a35e0-815d-468e-9080-7aeb222f4156 req-4a01d718-ecf7-49a1-aeec-261b3cfb2a62 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Refreshing network info cache for port 63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'flavor' on Instance uuid 57779903-c965-4099-b4fd-d934e02181dd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.network.neutron [req-972a35e0-815d-468e-9080-7aeb222f4156 req-4a01d718-ecf7-49a1-aeec-261b3cfb2a62 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updated VIF entry in instance network info cache for port 63c9ec21-cedf-40fb-bb88-137fdb0ada25. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.network.neutron [req-972a35e0-815d-468e-9080-7aeb222f4156 req-4a01d718-ecf7-49a1-aeec-261b3cfb2a62 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updating instance_info_cache with network_info: [{"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-4197908e-e5cf-43d2-a861-ae046aa8a03f req-90042f76-703d-4f88-a335-aea09fd01b8f service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-unplugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4197908e-e5cf-43d2-a861-ae046aa8a03f req-90042f76-703d-4f88-a335-aea09fd01b8f service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4197908e-e5cf-43d2-a861-ae046aa8a03f req-90042f76-703d-4f88-a335-aea09fd01b8f service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4197908e-e5cf-43d2-a861-ae046aa8a03f req-90042f76-703d-4f88-a335-aea09fd01b8f service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-4197908e-e5cf-43d2-a861-ae046aa8a03f req-90042f76-703d-4f88-a335-aea09fd01b8f service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-unplugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:05 user nova-compute[74587]: WARNING nova.compute.manager [req-4197908e-e5cf-43d2-a861-ae046aa8a03f req-90042f76-703d-4f88-a335-aea09fd01b8f service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-unplugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:20:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-972a35e0-815d-468e-9080-7aeb222f4156 req-4a01d718-ecf7-49a1-aeec-261b3cfb2a62 service nova] Releasing lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:05 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Instance destroyed successfully.
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:06 user nova-compute[74587]: INFO nova.compute.manager [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Attaching volume e2af70e1-c57e-41fd-85cc-308b0ae14f17 to /dev/vdb
Oct 18 07:20:06 user nova-compute[74587]: DEBUG nova.network.neutron [req-1b7b929e-8603-4ca4-863e-775c46e14124 req-66748b2c-09a7-4daa-ab36-8c5413121d50 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Updated VIF entry in instance network info cache for port deba39b8-e178-4b6a-bf64-6b36d2980719. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG nova.network.neutron [req-1b7b929e-8603-4ca4-863e-775c46e14124 req-66748b2c-09a7-4daa-ab36-8c5413121d50 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Updating instance_info_cache with network_info: [{"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG os_brick.utils [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1b7b929e-8603-4ca4-863e-775c46e14124 req-66748b2c-09a7-4daa-ab36-8c5413121d50 service nova] Releasing lock "refresh_cache-57779903-c965-4099-b4fd-d934e02181dd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc470b24-ce88-4486-a21e-6eeaaa598566]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6986bbc-7bf9-4c50-9a40-1f82ea761c89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d3e262-6fce-4c98-ab9c-2056e35d0664]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93dfb0b-fa54-4cd4-9014-c096d6bca73e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:20:06 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:20:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbaac9f-ec68-44ba-91ee-f2fee3c2d93e]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG os_brick.utils [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Updating existing volume attachment record: e09814a5-dcbf-4e95-b0e7-7ad36102f7a9 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:20:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-69fe6e5b-b54c-4101-8ba5-2a5bf19ed0b0 req-892fd728-f5ae-4f86-ae56-87223fd1c07a service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-changed-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-69fe6e5b-b54c-4101-8ba5-2a5bf19ed0b0 req-892fd728-f5ae-4f86-ae56-87223fd1c07a service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Refreshing instance network info cache due to event network-changed-63c9ec21-cedf-40fb-bb88-137fdb0ada25. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:20:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69fe6e5b-b54c-4101-8ba5-2a5bf19ed0b0 req-892fd728-f5ae-4f86-ae56-87223fd1c07a service nova] Acquiring lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69fe6e5b-b54c-4101-8ba5-2a5bf19ed0b0 req-892fd728-f5ae-4f86-ae56-87223fd1c07a service nova] Acquired lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:07 user nova-compute[74587]: DEBUG nova.network.neutron [req-69fe6e5b-b54c-4101-8ba5-2a5bf19ed0b0 req-892fd728-f5ae-4f86-ae56-87223fd1c07a service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Refreshing network info cache for port 63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:20:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:08 user nova-compute[74587]: WARNING nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-unplugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-unplugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:08 user nova-compute[74587]: WARNING nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-unplugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:08 user nova-compute[74587]: WARNING nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:08 user nova-compute[74587]: WARNING nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:08 user nova-compute[74587]: WARNING nova.compute.manager [req-22010f07-728e-450f-a773-39910d36dd77 req-86c147c9-f161-436a-8746-6c29d9b8c4b3 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.network.neutron [req-69fe6e5b-b54c-4101-8ba5-2a5bf19ed0b0 req-892fd728-f5ae-4f86-ae56-87223fd1c07a service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updated VIF entry in instance network info cache for port 63c9ec21-cedf-40fb-bb88-137fdb0ada25. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG nova.network.neutron [req-69fe6e5b-b54c-4101-8ba5-2a5bf19ed0b0 req-892fd728-f5ae-4f86-ae56-87223fd1c07a service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updating instance_info_cache with network_info: [{"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69fe6e5b-b54c-4101-8ba5-2a5bf19ed0b0 req-892fd728-f5ae-4f86-ae56-87223fd1c07a service nova] Releasing lock "refresh_cache-18ce6cb0-9632-4361-8d88-1b751e54ea71" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-cb5edd3a-5913-4809-b78a-227430b10438 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:10 user nova-compute[74587]: WARNING nova.compute.manager [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:20:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:10 user nova-compute[74587]: WARNING nova.compute.manager [req-e407e99e-3674-45b1-95f0-9b3eb3f162f3 req-50f5cbd1-9b65-425a-964a-40a18c0c2862 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:20:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b4fc3285-5e7a-4e21-b47d-2062af77b0ab tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:20:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:20:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Creating image(s)
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Ensure instance console log exists: /opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Start _get_guest_xml network_info=[{"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8d534e75-9099-4eac-aded-fca69ece9e75', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDrmwoAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f377ac1a-df76-49e1-b727-916d01a7fd02', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab89c35b-81e5-4b3c-8bc9-648be8bf10f1', 'serial': 'ab89c35b-81e5-4b3c-8bc9-648be8bf10f1'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:20:12 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:20:12 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDrmwoAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:20:12 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:20:12 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:20:12 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[396a61f4-1f27-458e-990b-fe1c902eef66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:20:12 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8296ce-2923-478a-be3d-7b6e0f9d7401]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1] added
Oct 18 07:20:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b1d689-42dd-46b0-b0d0-ce92366821c9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.047s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fb7728-be3d-4d7b-82b4-ad34fb9f365a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDrmwoAQ {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDrmwoAQ" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b604a2fc-b2d5-4303-b5f9-636ee824dc3a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lDrmwoAQ'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[408d2e51-be97-4f95-95bb-25e2d8b33592]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[797752d1-630f-4f61-876a-660c9dacf1f7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:12 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:12 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:12 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:12 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:12 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:12 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:20:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc05d4d8-f428-48ee-a702-bc6e578095ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1, portal: 172.16.0.220,3260]
Oct 18 07:20:13 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1, portal: 172.16.0.220,3260] successful.
Oct 18 07:20:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6499795-f8d7-4fa8-abaa-640c5a20b6fa]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8406bc42-7b6a-4c08-843e-4c331bb63ce6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:13 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:13 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:13 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:13 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:13 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:13 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:13 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:13 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.478s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ff6419-47c6-4a59-9d9e-27669a08d92e]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDrmwoAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] <== connect_volume: return (1542ms) {'type': 'block', 'scsi_wwn': '23733313638646366', 'path': '/dev/sdf'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733313638646366', 'path': '/dev/sdf'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:19:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2083496532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2083496532',id=22,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-bcandgus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:19:36Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=f377ac1a-df76-49e1-b727-916d01a7fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:0a:47,bridge_name='br-int',has_traffic_filtering=True,id=ae030258-2fea-414a-9e11-2db1da2515f4,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae030258-2f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'pci_devices' on Instance uuid f377ac1a-df76-49e1-b727-916d01a7fd02 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:20:14 user nova-compute[74587]:   <uuid>f377ac1a-df76-49e1-b727-916d01a7fd02</uuid>
Oct 18 07:20:14 user nova-compute[74587]:   <name>instance-00000016</name>
Oct 18 07:20:14 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:20:14 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:20:14 user nova-compute[74587]:   <metadata>
Oct 18 07:20:14 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:20:14 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:20:14 user nova-compute[74587]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2083496532</nova:name>
Oct 18 07:20:14 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:20:12</nova:creationTime>
Oct 18 07:20:14 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:20:14 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:20:14 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:20:14 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:20:14 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:20:14 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:20:14 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:20:14 user nova-compute[74587]:       <nova:owner>
Oct 18 07:20:14 user nova-compute[74587]:         <nova:user uuid="e2ca09ce37384d25931eb9a658384255">tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member</nova:user>
Oct 18 07:20:14 user nova-compute[74587]:         <nova:project uuid="c002a125aec54fa388965a9f83cc1624">tempest-ServerBootFromVolumeStableRescueTest-1990729548</nova:project>
Oct 18 07:20:14 user nova-compute[74587]:       </nova:owner>
Oct 18 07:20:14 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:20:14 user nova-compute[74587]:       <nova:ports>
Oct 18 07:20:14 user nova-compute[74587]:         <nova:port uuid="ae030258-2fea-414a-9e11-2db1da2515f4">
Oct 18 07:20:14 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:20:14 user nova-compute[74587]:         </nova:port>
Oct 18 07:20:14 user nova-compute[74587]:       </nova:ports>
Oct 18 07:20:14 user nova-compute[74587]:     </nova:instance>
Oct 18 07:20:14 user nova-compute[74587]:   </metadata>
Oct 18 07:20:14 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:20:14 user nova-compute[74587]:     <system>
Oct 18 07:20:14 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:20:14 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:20:14 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:20:14 user nova-compute[74587]:       <entry name="serial">f377ac1a-df76-49e1-b727-916d01a7fd02</entry>
Oct 18 07:20:14 user nova-compute[74587]:       <entry name="uuid">f377ac1a-df76-49e1-b727-916d01a7fd02</entry>
Oct 18 07:20:14 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:20:14 user nova-compute[74587]:     </system>
Oct 18 07:20:14 user nova-compute[74587]:   </sysinfo>
Oct 18 07:20:14 user nova-compute[74587]:   <os>
Oct 18 07:20:14 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:20:14 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:20:14 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:20:14 user nova-compute[74587]:   </os>
Oct 18 07:20:14 user nova-compute[74587]:   <features>
Oct 18 07:20:14 user nova-compute[74587]:     <acpi/>
Oct 18 07:20:14 user nova-compute[74587]:     <apic/>
Oct 18 07:20:14 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:20:14 user nova-compute[74587]:   </features>
Oct 18 07:20:14 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:20:14 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:20:14 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:20:14 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:20:14 user nova-compute[74587]:   </clock>
Oct 18 07:20:14 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:20:14 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:20:14 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:20:14 user nova-compute[74587]:   </cpu>
Oct 18 07:20:14 user nova-compute[74587]:   <devices>
Oct 18 07:20:14 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:20:14 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:20:14 user nova-compute[74587]:       <source dev="/dev/sdf"/>
Oct 18 07:20:14 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:20:14 user nova-compute[74587]:       <serial>ab89c35b-81e5-4b3c-8bc9-648be8bf10f1</serial>
Oct 18 07:20:14 user nova-compute[74587]:     </disk>
Oct 18 07:20:14 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:20:14 user nova-compute[74587]:       <mac address="fa:16:3e:81:0a:47"/>
Oct 18 07:20:14 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:20:14 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:20:14 user nova-compute[74587]:       <target dev="tapae030258-2f"/>
Oct 18 07:20:14 user nova-compute[74587]:     </interface>
Oct 18 07:20:14 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:20:14 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/console.log" append="off"/>
Oct 18 07:20:14 user nova-compute[74587]:     </serial>
Oct 18 07:20:14 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:20:14 user nova-compute[74587]:     <video>
Oct 18 07:20:14 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:20:14 user nova-compute[74587]:     </video>
Oct 18 07:20:14 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:20:14 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:20:14 user nova-compute[74587]:     </rng>
Oct 18 07:20:14 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:20:14 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:20:14 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:20:14 user nova-compute[74587]:     </memballoon>
Oct 18 07:20:14 user nova-compute[74587]:   </devices>
Oct 18 07:20:14 user nova-compute[74587]: </domain>
Oct 18 07:20:14 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:19:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2083496532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2083496532',id=22,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-bcandgus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:19:36Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=f377ac1a-df76-49e1-b727-916d01a7fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:0a:47,bridge_name='br-int',has_traffic_filtering=True,id=ae030258-2fea-414a-9e11-2db1da2515f4,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae030258-2f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG os_vif [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:0a:47,bridge_name='br-int',has_traffic_filtering=True,id=ae030258-2fea-414a-9e11-2db1da2515f4,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae030258-2f') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd7c10bf-7621-5347-aa00-b7e330b3bf8f', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae030258-2f, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae030258-2f, col_values=(('qos', UUID('4322525a-0c43-4937-a422-9e11a58532b4')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae030258-2f, col_values=(('external_ids', {'iface-id': 'ae030258-2fea-414a-9e11-2db1da2515f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:0a:47', 'vm-uuid': 'f377ac1a-df76-49e1-b727-916d01a7fd02'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:14 user nova-compute[74587]: INFO os_vif [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:0a:47,bridge_name='br-int',has_traffic_filtering=True,id=ae030258-2fea-414a-9e11-2db1da2515f4,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae030258-2f')
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:20:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No VIF found with MAC fa:16:3e:81:0a:47, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:20:15 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:20:15 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:20:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:15 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updating instance_info_cache with network_info: [{"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:20:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-f6b6421c-5b14-430c-85c6-d023bec95d4f req-5cf800ca-6f6e-431c-ab47-c0c46a35ca2e service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f6b6421c-5b14-430c-85c6-d023bec95d4f req-5cf800ca-6f6e-431c-ab47-c0c46a35ca2e service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f6b6421c-5b14-430c-85c6-d023bec95d4f req-5cf800ca-6f6e-431c-ab47-c0c46a35ca2e service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f6b6421c-5b14-430c-85c6-d023bec95d4f req-5cf800ca-6f6e-431c-ab47-c0c46a35ca2e service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-f6b6421c-5b14-430c-85c6-d023bec95d4f req-5cf800ca-6f6e-431c-ab47-c0c46a35ca2e service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:17 user nova-compute[74587]: WARNING nova.compute.manager [req-f6b6421c-5b14-430c-85c6-d023bec95d4f req-5cf800ca-6f6e-431c-ab47-c0c46a35ca2e service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state building and task_state spawning.
Oct 18 07:20:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:20:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:17 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:20:18 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:20:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:20:18 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Instance spawned successfully.
Oct 18 07:20:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:20:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:18 user nova-compute[74587]: INFO nova.compute.manager [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Took 6.26 seconds to spawn the instance on the hypervisor.
Oct 18 07:20:18 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:20:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:18 user nova-compute[74587]: INFO nova.compute.manager [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Took 44.09 seconds to build instance.
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e0b90b37-f768-4b27-8e61-d32ffc037be4 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.201s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-52fca186-60b2-4039-b489-a48078e819d4 req-7f3f0f1b-c491-42c9-89e3-9ebdb5a2afdb service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-52fca186-60b2-4039-b489-a48078e819d4 req-7f3f0f1b-c491-42c9-89e3-9ebdb5a2afdb service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-52fca186-60b2-4039-b489-a48078e819d4 req-7f3f0f1b-c491-42c9-89e3-9ebdb5a2afdb service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-52fca186-60b2-4039-b489-a48078e819d4 req-7f3f0f1b-c491-42c9-89e3-9ebdb5a2afdb service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-52fca186-60b2-4039-b489-a48078e819d4 req-7f3f0f1b-c491-42c9-89e3-9ebdb5a2afdb service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:19 user nova-compute[74587]: WARNING nova.compute.manager [req-52fca186-60b2-4039-b489-a48078e819d4 req-7f3f0f1b-c491-42c9-89e3-9ebdb5a2afdb service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state active and task_state None.
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:20:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:20:21 user nova-compute[74587]: INFO nova.compute.claims [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Claim successful on node user
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:20:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.959s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:20:22 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:20:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG nova.policy [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d72c3d757ed49adafd674fb5ee1e44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9c959e5f6494d82b4fae0fb9123f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:20:22 user nova-compute[74587]: INFO nova.virt.block_device [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Booting with volume 17848046-ec39-4558-aee8-75180f56091a at /dev/vda
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG os_brick.utils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd115131-0c05-4b66-9696-3915b12f36bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a14156d-b8e0-4044-88b4-fcb8de9ef00b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b21bbb7-4d00-47d9-b2dd-62c4e621962c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f0c40c-c191-4ce5-b10b-f24dd46b007d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:20:22 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[46756d61-4efa-4211-9f27-d09463f8ae6b]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG os_brick.utils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Updating existing volume attachment record: 352dde84-b932-4455-8696-44b7add09790 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:20:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Successfully created port: fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:20:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Successfully updated port: fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "refresh_cache-a61094a5-cbd8-4dd1-9514-d22cffb95d37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquired lock "refresh_cache-a61094a5-cbd8-4dd1-9514-d22cffb95d37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG nova.compute.manager [req-89412c15-d495-4661-b535-166106539fdf req-4d85ae58-dd52-4a9d-9906-2cefa060ae05 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-changed-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG nova.compute.manager [req-89412c15-d495-4661-b535-166106539fdf req-4d85ae58-dd52-4a9d-9906-2cefa060ae05 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Refreshing instance network info cache due to event network-changed-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89412c15-d495-4661-b535-166106539fdf req-4d85ae58-dd52-4a9d-9906-2cefa060ae05 service nova] Acquiring lock "refresh_cache-a61094a5-cbd8-4dd1-9514-d22cffb95d37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Updating instance_info_cache with network_info: [{"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Releasing lock "refresh_cache-a61094a5-cbd8-4dd1-9514-d22cffb95d37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Instance network_info: |[{"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89412c15-d495-4661-b535-166106539fdf req-4d85ae58-dd52-4a9d-9906-2cefa060ae05 service nova] Acquired lock "refresh_cache-a61094a5-cbd8-4dd1-9514-d22cffb95d37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:24 user nova-compute[74587]: DEBUG nova.network.neutron [req-89412c15-d495-4661-b535-166106539fdf req-4d85ae58-dd52-4a9d-9906-2cefa060ae05 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Refreshing network info cache for port fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:20:25 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:20:25 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7767MB free_disk=25.06740951538086GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance e82e7877-9569-4a62-9fff-48d4bcca3848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee7e9ad7-fe94-4031-885c-ad134624135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 57779903-c965-4099-b4fd-d934e02181dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance f377ac1a-df76-49e1-b727-916d01a7fd02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 5313fc03-fe27-471c-b0b1-ae9806bbe2a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a61094a5-cbd8-4dd1-9514-d22cffb95d37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.network.neutron [req-89412c15-d495-4661-b535-166106539fdf req-4d85ae58-dd52-4a9d-9906-2cefa060ae05 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Updated VIF entry in instance network info cache for port fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.network.neutron [req-89412c15-d495-4661-b535-166106539fdf req-4d85ae58-dd52-4a9d-9906-2cefa060ae05 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Updating instance_info_cache with network_info: [{"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89412c15-d495-4661-b535-166106539fdf req-4d85ae58-dd52-4a9d-9906-2cefa060ae05 service nova] Releasing lock "refresh_cache-a61094a5-cbd8-4dd1-9514-d22cffb95d37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:20:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.715s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:20:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:20:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEKFqhnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:20:28 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:20:28 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:20:28 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df5e18f-ab94-4aca-810f-abb8e1faee92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:20:28 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1f0e19-a09b-467f-b8ca-caca1c12ede7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17] added
Oct 18 07:20:28 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2db9282-7a7a-465f-b2ce-17a7cd015f8a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca99871-8688-4c04-9ec1-9438c7bb185f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEKFqhnZ {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEKFqhnZ" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded1f43e-795b-418a-b904-73aebf5e332e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fEKFqhnZ'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f997fa54-6b28-47ed-aaf7-32b11243ee6f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b12c71-9ccf-4d2e-9805-758955b5339a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32fe61a-751b-403f-b87e-bd6b81eba500]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260]
Oct 18 07:20:28 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260] successful.
Oct 18 07:20:28 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7915f95-5559-4d01-ad61-a7955fe018e5]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe091e8a-4462-4873-84b6-eb5a3015d7d8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:20:28 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea256d0-be0f-47f4-b666-05564fe29773]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:20:28 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEKFqhnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:20:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:20:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26330383532383737', 'path': '/dev/sdg'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:20:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330383532383737', 'path': '/dev/sdg'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:20:29 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'flavor' on Instance uuid 57779903-c965-4099-b4fd-d934e02181dd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:20:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:20:29 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:20:29 user nova-compute[74587]:   <source dev="/dev/sdg"/>
Oct 18 07:20:29 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:20:29 user nova-compute[74587]:   <serial>e2af70e1-c57e-41fd-85cc-308b0ae14f17</serial>
Oct 18 07:20:29 user nova-compute[74587]: </disk>
Oct 18 07:20:29 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:20:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:20:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:20:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No VIF found with MAC fa:16:3e:e4:25:0d, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:20:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3bbd0514-2001-405a-af21-370f822aab72 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.243s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:31 user nova-compute[74587]: INFO nova.compute.manager [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Rebuilding instance
Oct 18 07:20:31 user nova-compute[74587]: DEBUG nova.compute.manager [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:20:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-ac6944da-f679-4c14-82fe-a1b8396ea4ac req-b20e7b4a-9150-4c7d-adc1-57fefb433951 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-vif-unplugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ac6944da-f679-4c14-82fe-a1b8396ea4ac req-b20e7b4a-9150-4c7d-adc1-57fefb433951 service nova] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ac6944da-f679-4c14-82fe-a1b8396ea4ac req-b20e7b4a-9150-4c7d-adc1-57fefb433951 service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ac6944da-f679-4c14-82fe-a1b8396ea4ac req-b20e7b4a-9150-4c7d-adc1-57fefb433951 service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-ac6944da-f679-4c14-82fe-a1b8396ea4ac req-b20e7b4a-9150-4c7d-adc1-57fefb433951 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] No waiting events found dispatching network-vif-unplugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:32 user nova-compute[74587]: WARNING nova.compute.manager [req-ac6944da-f679-4c14-82fe-a1b8396ea4ac req-b20e7b4a-9150-4c7d-adc1-57fefb433951 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received unexpected event network-vif-unplugged-deba39b8-e178-4b6a-bf64-6b36d2980719 for instance with vm_state active and task_state rebuilding.
Oct 18 07:20:32 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Instance destroyed successfully.
Oct 18 07:20:32 user nova-compute[74587]: INFO nova.compute.manager [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Detaching volume e2af70e1-c57e-41fd-85cc-308b0ae14f17
Oct 18 07:20:32 user nova-compute[74587]: INFO nova.virt.block_device [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Attempting to driver detach volume e2af70e1-c57e-41fd-85cc-308b0ae14f17 from mountpoint /dev/vdb
Oct 18 07:20:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Attempting to detach device vdb from instance 57779903-c965-4099-b4fd-d934e02181dd from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:20:32 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:20:32 user nova-compute[74587]:   <source dev="/dev/sdg"/>
Oct 18 07:20:32 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:20:32 user nova-compute[74587]:   <serial>e2af70e1-c57e-41fd-85cc-308b0ae14f17</serial>
Oct 18 07:20:32 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:20:32 user nova-compute[74587]: </disk>
Oct 18 07:20:32 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:20:32 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully detached device vdb from instance 57779903-c965-4099-b4fd-d934e02181dd from the persistent domain config.
Oct 18 07:20:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEKFqhnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:20:32 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7cfbd5-46cd-4fa8-9737-eda3c5376364]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:20:32 user nova-compute[74587]: No targets found.
Oct 18 07:20:32 user nova-compute[74587]: iSNS:
Oct 18 07:20:32 user nova-compute[74587]: No targets found.
Oct 18 07:20:32 user nova-compute[74587]: STATIC:
Oct 18 07:20:32 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f
Oct 18 07:20:32 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:32 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:32 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17
Oct 18 07:20:32 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:32 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:32 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:20:32 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:32 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:32 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51
Oct 18 07:20:32 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:32 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:32 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:20:32 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:32 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:32 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3
Oct 18 07:20:32 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:32 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:32 user nova-compute[74587]: FIRMWARE:
Oct 18 07:20:32 user nova-compute[74587]: No targets found.
Oct 18 07:20:32 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:20:32 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:20:32 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efcc788-cf01-4163-bdef-fe97e1793c7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bced7134-c416-45e0-bed0-d78b027434c6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:32 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:32 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:32 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:32 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:32 user nova-compute[74587]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:20:32 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:32 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:32 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:32 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:32 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:32 user nova-compute[74587]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:20:32 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10083edc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17'): ({'sdg'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Removing single pathed devices sdg {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad4ab9d-0603-4c5f-881d-e5dc8f00696b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8d9c4c-f829-4ca0-822c-06b305b35e25]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flushing IO for device /dev/sdg {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[41483a26-882f-4a3b-bcf6-c775c31a3f53]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:20:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8412672-ce3d-4728-ac26-3905f13179bf]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] SCSI volumes sdg have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f315f4e-d3ce-487e-9ed8-4172c07e3a20]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4dbc75-acf4-4e87-9e82-2e0a67869ce9]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260]
Oct 18 07:20:33 user nova-compute[74587]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260] successful.
Oct 18 07:20:33 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eb2fb0-abd1-4227-ba2d-5a182a36843e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== disconnect_volume: return (352ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:20:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:20:34 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Instance destroyed successfully.
Oct 18 07:20:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-131303816',display_name='tempest-ServerActionsTestOtherA-server-148190764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-131303816',id=21,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtvGfBTkmICl93Y629GSp9vxRmRb7ktS6MkPEYxnd5r5dWprV6nU6Bni5nfUEjdsOZs2O5IEA4YwJeshclRhNFjFWY1pmae36/MF/uwYENjseuyRf+tfHlT2QHevzVfsg==',key_name='tempest-keypair-1663639896',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:18:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-1mfq5t8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:20:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=57779903-c965-4099-b4fd-d934e02181dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_vif [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeba39b8-e1, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f255cce-0dac-4be3-a64a-1cde9b708219) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:20:34 user nova-compute[74587]: INFO os_vif [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1')
Oct 18 07:20:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEKFqhnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:20:34 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-3b9e00d4-94d6-4689-b17d-519d8c4051c3 req-6bee190f-491f-4b4d-8408-17e5b7113f1e service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3b9e00d4-94d6-4689-b17d-519d8c4051c3 req-6bee190f-491f-4b4d-8408-17e5b7113f1e service nova] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3b9e00d4-94d6-4689-b17d-519d8c4051c3 req-6bee190f-491f-4b4d-8408-17e5b7113f1e service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3b9e00d4-94d6-4689-b17d-519d8c4051c3 req-6bee190f-491f-4b4d-8408-17e5b7113f1e service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-3b9e00d4-94d6-4689-b17d-519d8c4051c3 req-6bee190f-491f-4b4d-8408-17e5b7113f1e service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] No waiting events found dispatching network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:34 user nova-compute[74587]: WARNING nova.compute.manager [req-3b9e00d4-94d6-4689-b17d-519d8c4051c3 req-6bee190f-491f-4b4d-8408-17e5b7113f1e service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received unexpected event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 for instance with vm_state active and task_state rebuilding.
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5522c55-c2f1-4f52-b1c9-eac095d06311]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:20:34 user nova-compute[74587]: No targets found.
Oct 18 07:20:34 user nova-compute[74587]: iSNS:
Oct 18 07:20:34 user nova-compute[74587]: No targets found.
Oct 18 07:20:34 user nova-compute[74587]: STATIC:
Oct 18 07:20:34 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f
Oct 18 07:20:34 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:34 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:34 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:20:34 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:34 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:34 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51
Oct 18 07:20:34 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:34 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:34 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:20:34 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:34 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:34 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3
Oct 18 07:20:34 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:20:34 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:20:34 user nova-compute[74587]: FIRMWARE:
Oct 18 07:20:34 user nova-compute[74587]: No targets found.
Oct 18 07:20:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:20:34 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:20:34 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[915e18fe-a244-4f5a-941c-2af7c225368d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d86c70d-1f58-43cd-90ed-7a9b5479dc31]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:34 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:34 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:34 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:34 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:34 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:34 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:34 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:34 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4537760>, {}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Disconnecting from: [] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.095s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== disconnect_volume: return (97ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:20:34 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Deleting instance files /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd_del
Oct 18 07:20:34 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Deletion of /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd_del complete
Oct 18 07:20:34 user nova-compute[74587]: INFO nova.virt.block_device [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Booting with volume e2af70e1-c57e-41fd-85cc-308b0ae14f17 at /dev/vdb
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.utils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e86c93-5b2c-4a5c-a7c5-8dbcb7a80d29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38a7ba7-2616-4244-a47c-ad4abb87ba75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7731cf4e-c01d-434c-9c80-924cf7a2f763]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e176b7-80c0-4c7a-856e-479bea6a828c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:20:34 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:20:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aa439f-7e72-4c76-94a7-f8c3873f981c]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG os_brick.utils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:20:34 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Updating existing volume attachment record: 9fccd833-6c79-4c2d-8107-2059f154b56e {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:20:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:36 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:20:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:20:36 user nova-compute[74587]: INFO nova.compute.claims [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Claim successful on node user
Oct 18 07:20:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:20:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:20:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG nova.policy [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af9278b67f224f1695c90223a4dc1181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35bbc4b5dcf34f2a8eedb939389e7234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:20:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Creating image(s)
Oct 18 07:20:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "/opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "/opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "/opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.288s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Successfully created port: 6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.235s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk 1073741824" returned: 0 in 0.232s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.473s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Cannot resize image /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Ensure instance console log exists: /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Successfully updated port: 6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquired lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-1a7beecd-5e19-4c04-9148-48c0b49a09c1 req-11ecbbc6-919b-44e1-9b3c-0f195f4dd57a service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-changed-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-1a7beecd-5e19-4c04-9148-48c0b49a09c1 req-11ecbbc6-919b-44e1-9b3c-0f195f4dd57a service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Refreshing instance network info cache due to event network-changed-6b0a10ff-6fe0-4564-b1ea-29cc81f01924. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1a7beecd-5e19-4c04-9148-48c0b49a09c1 req-11ecbbc6-919b-44e1-9b3c-0f195f4dd57a service nova] Acquiring lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updating instance_info_cache with network_info: [{"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Releasing lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Instance network_info: |[{"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1a7beecd-5e19-4c04-9148-48c0b49a09c1 req-11ecbbc6-919b-44e1-9b3c-0f195f4dd57a service nova] Acquired lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.neutron [req-1a7beecd-5e19-4c04-9148-48c0b49a09c1 req-11ecbbc6-919b-44e1-9b3c-0f195f4dd57a service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Refreshing network info cache for port 6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Start _get_guest_xml network_info=[{"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:20:39 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:20:39 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1244513542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1244513542',id=25,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy2/cWP8WQ1La5/QKuL3jYChPeN0VPAAZ3nrF6uVf9b1QBGYXd0EDBi2DmgRL39gFo910hg16O6gyhq3Su5lGILbUf2jiLTF5VIlvuS+se1aJqzZiOC2YYW1GdUWIn5/w==',key_name='tempest-keypair-1932888942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-y1fpij3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=db21a40f-ceef-4c74-949f-80b83c82f1e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.objects.instance [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'pci_devices' on Instance uuid db21a40f-ceef-4c74-949f-80b83c82f1e5 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:20:39 user nova-compute[74587]:   <uuid>db21a40f-ceef-4c74-949f-80b83c82f1e5</uuid>
Oct 18 07:20:39 user nova-compute[74587]:   <name>instance-00000019</name>
Oct 18 07:20:39 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:20:39 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:20:39 user nova-compute[74587]:   <metadata>
Oct 18 07:20:39 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:20:39 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:20:39 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1244513542</nova:name>
Oct 18 07:20:39 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:20:39</nova:creationTime>
Oct 18 07:20:39 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:20:39 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:20:39 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:20:39 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:20:39 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:20:39 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:20:39 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:20:39 user nova-compute[74587]:       <nova:owner>
Oct 18 07:20:39 user nova-compute[74587]:         <nova:user uuid="af9278b67f224f1695c90223a4dc1181">tempest-AttachVolumeShelveTestJSON-1000148669-project-member</nova:user>
Oct 18 07:20:39 user nova-compute[74587]:         <nova:project uuid="35bbc4b5dcf34f2a8eedb939389e7234">tempest-AttachVolumeShelveTestJSON-1000148669</nova:project>
Oct 18 07:20:39 user nova-compute[74587]:       </nova:owner>
Oct 18 07:20:39 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:20:39 user nova-compute[74587]:       <nova:ports>
Oct 18 07:20:39 user nova-compute[74587]:         <nova:port uuid="6b0a10ff-6fe0-4564-b1ea-29cc81f01924">
Oct 18 07:20:39 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 07:20:39 user nova-compute[74587]:         </nova:port>
Oct 18 07:20:39 user nova-compute[74587]:       </nova:ports>
Oct 18 07:20:39 user nova-compute[74587]:     </nova:instance>
Oct 18 07:20:39 user nova-compute[74587]:   </metadata>
Oct 18 07:20:39 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:20:39 user nova-compute[74587]:     <system>
Oct 18 07:20:39 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:20:39 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:20:39 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:20:39 user nova-compute[74587]:       <entry name="serial">db21a40f-ceef-4c74-949f-80b83c82f1e5</entry>
Oct 18 07:20:39 user nova-compute[74587]:       <entry name="uuid">db21a40f-ceef-4c74-949f-80b83c82f1e5</entry>
Oct 18 07:20:39 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:20:39 user nova-compute[74587]:     </system>
Oct 18 07:20:39 user nova-compute[74587]:   </sysinfo>
Oct 18 07:20:39 user nova-compute[74587]:   <os>
Oct 18 07:20:39 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:20:39 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:20:39 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:20:39 user nova-compute[74587]:   </os>
Oct 18 07:20:39 user nova-compute[74587]:   <features>
Oct 18 07:20:39 user nova-compute[74587]:     <acpi/>
Oct 18 07:20:39 user nova-compute[74587]:     <apic/>
Oct 18 07:20:39 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:20:39 user nova-compute[74587]:   </features>
Oct 18 07:20:39 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:20:39 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:20:39 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:20:39 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:20:39 user nova-compute[74587]:   </clock>
Oct 18 07:20:39 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:20:39 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:20:39 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:20:39 user nova-compute[74587]:   </cpu>
Oct 18 07:20:39 user nova-compute[74587]:   <devices>
Oct 18 07:20:39 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:20:39 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:20:39 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk"/>
Oct 18 07:20:39 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:20:39 user nova-compute[74587]:     </disk>
Oct 18 07:20:39 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:20:39 user nova-compute[74587]:       <mac address="fa:16:3e:b9:ef:f7"/>
Oct 18 07:20:39 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:20:39 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:20:39 user nova-compute[74587]:       <target dev="tap6b0a10ff-6f"/>
Oct 18 07:20:39 user nova-compute[74587]:     </interface>
Oct 18 07:20:39 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:20:39 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/console.log" append="off"/>
Oct 18 07:20:39 user nova-compute[74587]:     </serial>
Oct 18 07:20:39 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:20:39 user nova-compute[74587]:     <video>
Oct 18 07:20:39 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:20:39 user nova-compute[74587]:     </video>
Oct 18 07:20:39 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:20:39 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:20:39 user nova-compute[74587]:     </rng>
Oct 18 07:20:39 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:20:39 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:20:39 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:20:39 user nova-compute[74587]:     </memballoon>
Oct 18 07:20:39 user nova-compute[74587]:   </devices>
Oct 18 07:20:39 user nova-compute[74587]: </domain>
Oct 18 07:20:39 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1244513542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1244513542',id=25,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy2/cWP8WQ1La5/QKuL3jYChPeN0VPAAZ3nrF6uVf9b1QBGYXd0EDBi2DmgRL39gFo910hg16O6gyhq3Su5lGILbUf2jiLTF5VIlvuS+se1aJqzZiOC2YYW1GdUWIn5/w==',key_name='tempest-keypair-1932888942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-y1fpij3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=db21a40f-ceef-4c74-949f-80b83c82f1e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG os_vif [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d1989a1-1371-5aec-aa49-ef2231d14129', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b0a10ff-6f, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b0a10ff-6f, col_values=(('qos', UUID('a9c4796a-e459-49cd-9a25-42a1be2c8104')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b0a10ff-6f, col_values=(('external_ids', {'iface-id': '6b0a10ff-6fe0-4564-b1ea-29cc81f01924', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:ef:f7', 'vm-uuid': 'db21a40f-ceef-4c74-949f-80b83c82f1e5'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:39 user nova-compute[74587]: INFO os_vif [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f')
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] No VIF found with MAC fa:16:3e:b9:ef:f7, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.neutron [req-1a7beecd-5e19-4c04-9148-48c0b49a09c1 req-11ecbbc6-919b-44e1-9b3c-0f195f4dd57a service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updated VIF entry in instance network info cache for port 6b0a10ff-6fe0-4564-b1ea-29cc81f01924. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG nova.network.neutron [req-1a7beecd-5e19-4c04-9148-48c0b49a09c1 req-11ecbbc6-919b-44e1-9b3c-0f195f4dd57a service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updating instance_info_cache with network_info: [{"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1a7beecd-5e19-4c04-9148-48c0b49a09c1 req-11ecbbc6-919b-44e1-9b3c-0f195f4dd57a service nova] Releasing lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:39 user nova-compute[74587]: INFO nova.compute.manager [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Detaching volume e5e6656c-aaeb-46ff-855f-0427de81cb51
Oct 18 07:20:39 user nova-compute[74587]: INFO nova.virt.block_device [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Attempting to driver detach volume e5e6656c-aaeb-46ff-855f-0427de81cb51 from mountpoint /dev/vdb
Oct 18 07:20:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Attempting to detach device vdb from instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:20:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:20:40 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:20:40 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:20:40 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:20:40 user nova-compute[74587]:   <serial>e5e6656c-aaeb-46ff-855f-0427de81cb51</serial>
Oct 18 07:20:40 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:20:40 user nova-compute[74587]: </disk>
Oct 18 07:20:40 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:20:40 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Successfully detached device vdb from instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 from the persistent domain config.
Oct 18 07:20:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:20:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:20:40 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:20:40 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:20:40 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:20:40 user nova-compute[74587]:   <serial>e5e6656c-aaeb-46ff-855f-0427de81cb51</serial>
Oct 18 07:20:40 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:20:40 user nova-compute[74587]: </disk>
Oct 18 07:20:40 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:20:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:20:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-48d2e138-5fa2-4327-b37c-7397f0faa4b2 req-2dc425a1-952c-4627-bc8f-7e493ab4fb7d service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-48d2e138-5fa2-4327-b37c-7397f0faa4b2 req-2dc425a1-952c-4627-bc8f-7e493ab4fb7d service nova] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-48d2e138-5fa2-4327-b37c-7397f0faa4b2 req-2dc425a1-952c-4627-bc8f-7e493ab4fb7d service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-48d2e138-5fa2-4327-b37c-7397f0faa4b2 req-2dc425a1-952c-4627-bc8f-7e493ab4fb7d service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-48d2e138-5fa2-4327-b37c-7397f0faa4b2 req-2dc425a1-952c-4627-bc8f-7e493ab4fb7d service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] No waiting events found dispatching network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:41 user nova-compute[74587]: WARNING nova.compute.manager [req-48d2e138-5fa2-4327-b37c-7397f0faa4b2 req-2dc425a1-952c-4627-bc8f-7e493ab4fb7d service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received unexpected event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 for instance with vm_state building and task_state spawning.
Oct 18 07:20:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:20:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Creating image(s)
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Ensure instance console log exists: /opt/stack/data/nova/instances/a61094a5-cbd8-4dd1-9514-d22cffb95d37/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Start _get_guest_xml network_info=[{"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '352dde84-b932-4455-8696-44b7add09790', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuGrcIVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a61094a5-cbd8-4dd1-9514-d22cffb95d37', 'attached_at': '', 'detached_at': '', 'volume_id': '17848046-ec39-4558-aee8-75180f56091a', 'serial': '17848046-ec39-4558-aee8-75180f56091a'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:20:42 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:20:42 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuGrcIVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:20:42 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:20:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:20:42 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:20:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:20:42 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d36da7-1252-4eb5-9f2f-a13be491b718]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:20:42 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7fc5cd-86a2-4d7a-96ef-bd992ba340c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a] added
Oct 18 07:20:42 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a136ea4-4a8d-4ea6-87c9-e4ffd4afd665]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a652cb-807d-4248-ab4b-35c45b6e4eab]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CuGrcIVt {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CuGrcIVt" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1022a262-010d-4109-89cd-333552dd5f89]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CuGrcIVt'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d964a3b-b7bc-49b2-8fd1-0dd43b36184e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2e1361-c2d8-460e-b28c-7e2a3b2a1265]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[95342d79-cac4-4f6a-aeb2-4222b3b8749f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260]
Oct 18 07:20:43 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260] successful.
Oct 18 07:20:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fdcdfa-f68b-473c-b22d-5f341ffaf257]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2563c4-34db-480c-b622-9a06db336f80]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:20:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:43 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:20:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4773ed04-82f6-4012-9f22-15c2857ac094]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-a1ffd284-496a-43fa-a76b-24139ad74f61 req-9dccab82-4aea-4cc3-b3ff-4f04ff3548ee service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a1ffd284-496a-43fa-a76b-24139ad74f61 req-9dccab82-4aea-4cc3-b3ff-4f04ff3548ee service nova] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a1ffd284-496a-43fa-a76b-24139ad74f61 req-9dccab82-4aea-4cc3-b3ff-4f04ff3548ee service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a1ffd284-496a-43fa-a76b-24139ad74f61 req-9dccab82-4aea-4cc3-b3ff-4f04ff3548ee service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-a1ffd284-496a-43fa-a76b-24139ad74f61 req-9dccab82-4aea-4cc3-b3ff-4f04ff3548ee service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] No waiting events found dispatching network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:43 user nova-compute[74587]: WARNING nova.compute.manager [req-a1ffd284-496a-43fa-a76b-24139ad74f61 req-9dccab82-4aea-4cc3-b3ff-4f04ff3548ee service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received unexpected event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 for instance with vm_state building and task_state spawning.
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:20:43 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Instance spawned successfully.
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:44 user nova-compute[74587]: INFO nova.compute.manager [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Took 6.38 seconds to spawn the instance on the hypervisor.
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuGrcIVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23130633338323831', 'path': '/dev/sdg'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130633338323831', 'path': '/dev/sdg'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1188491975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1188491975',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb7AWTCUJMtWT+b6CO+0sC3i+/8jyR2wEzLDh9dRK0WqLzka8rM6W/97aV9qlO5Rr3hf8np+xqTDyEmyct3btj/WZrRH3GWfTzWe8m6/GmXDuKx72pEDYM8Ze3f2yy1+Q==',key_name='tempest-keypair-1211237030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99d9c959e5f6494d82b4fae0fb9123f3',ramdisk_id='',reservation_id='r-x8yh5wgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-474901938',owner_user_name='tempest-ServerActionsV293TestJSON-474901938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d72c3d757ed49adafd674fb5ee1e44f',uuid=a61094a5-cbd8-4dd1-9514-d22cffb95d37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converting VIF {"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.objects.instance [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lazy-loading 'pci_devices' on Instance uuid a61094a5-cbd8-4dd1-9514-d22cffb95d37 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:20:44 user nova-compute[74587]:   <uuid>a61094a5-cbd8-4dd1-9514-d22cffb95d37</uuid>
Oct 18 07:20:44 user nova-compute[74587]:   <name>instance-00000018</name>
Oct 18 07:20:44 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:20:44 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:20:44 user nova-compute[74587]:   <metadata>
Oct 18 07:20:44 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:20:44 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:20:44 user nova-compute[74587]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1188491975</nova:name>
Oct 18 07:20:44 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:20:42</nova:creationTime>
Oct 18 07:20:44 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:20:44 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:20:44 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:20:44 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:20:44 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:20:44 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:20:44 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:20:44 user nova-compute[74587]:       <nova:owner>
Oct 18 07:20:44 user nova-compute[74587]:         <nova:user uuid="4d72c3d757ed49adafd674fb5ee1e44f">tempest-ServerActionsV293TestJSON-474901938-project-member</nova:user>
Oct 18 07:20:44 user nova-compute[74587]:         <nova:project uuid="99d9c959e5f6494d82b4fae0fb9123f3">tempest-ServerActionsV293TestJSON-474901938</nova:project>
Oct 18 07:20:44 user nova-compute[74587]:       </nova:owner>
Oct 18 07:20:44 user nova-compute[74587]:       <nova:ports>
Oct 18 07:20:44 user nova-compute[74587]:         <nova:port uuid="fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2">
Oct 18 07:20:44 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:20:44 user nova-compute[74587]:         </nova:port>
Oct 18 07:20:44 user nova-compute[74587]:       </nova:ports>
Oct 18 07:20:44 user nova-compute[74587]:     </nova:instance>
Oct 18 07:20:44 user nova-compute[74587]:   </metadata>
Oct 18 07:20:44 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:20:44 user nova-compute[74587]:     <system>
Oct 18 07:20:44 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:20:44 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:20:44 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:20:44 user nova-compute[74587]:       <entry name="serial">a61094a5-cbd8-4dd1-9514-d22cffb95d37</entry>
Oct 18 07:20:44 user nova-compute[74587]:       <entry name="uuid">a61094a5-cbd8-4dd1-9514-d22cffb95d37</entry>
Oct 18 07:20:44 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:20:44 user nova-compute[74587]:     </system>
Oct 18 07:20:44 user nova-compute[74587]:   </sysinfo>
Oct 18 07:20:44 user nova-compute[74587]:   <os>
Oct 18 07:20:44 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:20:44 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:20:44 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:20:44 user nova-compute[74587]:   </os>
Oct 18 07:20:44 user nova-compute[74587]:   <features>
Oct 18 07:20:44 user nova-compute[74587]:     <acpi/>
Oct 18 07:20:44 user nova-compute[74587]:     <apic/>
Oct 18 07:20:44 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:20:44 user nova-compute[74587]:   </features>
Oct 18 07:20:44 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:20:44 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:20:44 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:20:44 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:20:44 user nova-compute[74587]:   </clock>
Oct 18 07:20:44 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:20:44 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:20:44 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:20:44 user nova-compute[74587]:   </cpu>
Oct 18 07:20:44 user nova-compute[74587]:   <devices>
Oct 18 07:20:44 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:20:44 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:20:44 user nova-compute[74587]:       <source dev="/dev/sdg"/>
Oct 18 07:20:44 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:20:44 user nova-compute[74587]:       <serial>17848046-ec39-4558-aee8-75180f56091a</serial>
Oct 18 07:20:44 user nova-compute[74587]:     </disk>
Oct 18 07:20:44 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:20:44 user nova-compute[74587]:       <mac address="fa:16:3e:ec:4b:38"/>
Oct 18 07:20:44 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:20:44 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:20:44 user nova-compute[74587]:       <target dev="tapfc4ce1ba-92"/>
Oct 18 07:20:44 user nova-compute[74587]:     </interface>
Oct 18 07:20:44 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:20:44 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/a61094a5-cbd8-4dd1-9514-d22cffb95d37/console.log" append="off"/>
Oct 18 07:20:44 user nova-compute[74587]:     </serial>
Oct 18 07:20:44 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:20:44 user nova-compute[74587]:     <video>
Oct 18 07:20:44 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:20:44 user nova-compute[74587]:     </video>
Oct 18 07:20:44 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:20:44 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:20:44 user nova-compute[74587]:     </rng>
Oct 18 07:20:44 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:20:44 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:20:44 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:20:44 user nova-compute[74587]:     </memballoon>
Oct 18 07:20:44 user nova-compute[74587]:   </devices>
Oct 18 07:20:44 user nova-compute[74587]: </domain>
Oct 18 07:20:44 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1188491975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1188491975',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb7AWTCUJMtWT+b6CO+0sC3i+/8jyR2wEzLDh9dRK0WqLzka8rM6W/97aV9qlO5Rr3hf8np+xqTDyEmyct3btj/WZrRH3GWfTzWe8m6/GmXDuKx72pEDYM8Ze3f2yy1+Q==',key_name='tempest-keypair-1211237030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99d9c959e5f6494d82b4fae0fb9123f3',ramdisk_id='',reservation_id='r-x8yh5wgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-474901938',owner_user_name='tempest-ServerActionsV293TestJSON-474901938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d72c3d757ed49adafd674fb5ee1e44f',uuid=a61094a5-cbd8-4dd1-9514-d22cffb95d37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converting VIF {"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG os_vif [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95067b99-8f72-5ce6-b117-a62c49e815cb', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:44 user nova-compute[74587]: INFO nova.compute.manager [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Took 7.84 seconds to build instance.
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc4ce1ba-92, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc4ce1ba-92, col_values=(('qos', UUID('b75174c7-a077-4614-bef6-a4755f3d846d')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc4ce1ba-92, col_values=(('external_ids', {'iface-id': 'fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:4b:38', 'vm-uuid': 'a61094a5-cbd8-4dd1-9514-d22cffb95d37'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7e0ce2c4-d8f6-41c8-9f23-ca556f20b257 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.955s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:44 user nova-compute[74587]: INFO os_vif [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92')
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:20:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] No VIF found with MAC fa:16:3e:ec:4b:38, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:20:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-e443a2f7-c6e8-4cea-a55c-22d416ad3c00 req-7977f9a8-23f5-4a44-87f2-fabd295cad49 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e443a2f7-c6e8-4cea-a55c-22d416ad3c00 req-7977f9a8-23f5-4a44-87f2-fabd295cad49 service nova] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e443a2f7-c6e8-4cea-a55c-22d416ad3c00 req-7977f9a8-23f5-4a44-87f2-fabd295cad49 service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e443a2f7-c6e8-4cea-a55c-22d416ad3c00 req-7977f9a8-23f5-4a44-87f2-fabd295cad49 service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-e443a2f7-c6e8-4cea-a55c-22d416ad3c00 req-7977f9a8-23f5-4a44-87f2-fabd295cad49 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] No waiting events found dispatching network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:46 user nova-compute[74587]: WARNING nova.compute.manager [req-e443a2f7-c6e8-4cea-a55c-22d416ad3c00 req-7977f9a8-23f5-4a44-87f2-fabd295cad49 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received unexpected event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 for instance with vm_state building and task_state spawning.
Oct 18 07:20:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-6ba054ca-1e96-4c39-bad5-b5a12342c280 req-854af4a9-0823-4608-ab89-a4523c7481fd service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6ba054ca-1e96-4c39-bad5-b5a12342c280 req-854af4a9-0823-4608-ab89-a4523c7481fd service nova] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6ba054ca-1e96-4c39-bad5-b5a12342c280 req-854af4a9-0823-4608-ab89-a4523c7481fd service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6ba054ca-1e96-4c39-bad5-b5a12342c280 req-854af4a9-0823-4608-ab89-a4523c7481fd service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-6ba054ca-1e96-4c39-bad5-b5a12342c280 req-854af4a9-0823-4608-ab89-a4523c7481fd service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] No waiting events found dispatching network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:48 user nova-compute[74587]: WARNING nova.compute.manager [req-6ba054ca-1e96-4c39-bad5-b5a12342c280 req-854af4a9-0823-4608-ab89-a4523c7481fd service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received unexpected event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 for instance with vm_state building and task_state spawning.
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:20:48 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Instance spawned successfully.
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:20:48 user nova-compute[74587]: INFO nova.compute.manager [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:20:48 user nova-compute[74587]: INFO nova.compute.manager [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Took 27.39 seconds to build instance.
Oct 18 07:20:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fb455d08-1feb-4f05-8c18-4f6fc02cf8e0 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.514s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "91a8e4f6-b0c6-4409-b947-3d687b2d606e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "91a8e4f6-b0c6-4409-b947-3d687b2d606e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:48 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:20:48 user nova-compute[74587]: INFO nova.compute.claims [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Claim successful on node user
Oct 18 07:20:49 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:20:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:49 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:20:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:20:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:20:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:20:49 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:20:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:20:49 user nova-compute[74587]: DEBUG nova.policy [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd13de789e98e4ba9ad22d665ff8e4ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cfa00773ba4c5498c56b84ccb307a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:20:49 user nova-compute[74587]: INFO nova.virt.block_device [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Booting with volume snapshot 625569a0-0bfc-44a9-9d89-ebb8cadb3fbe at /dev/vda
Oct 18 07:20:50 user nova-compute[74587]: DEBUG nova.network.neutron [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Successfully created port: e72b2856-0f6d-4646-b98b-86abbc73db54 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:20:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Successfully updated port: e72b2856-0f6d-4646-b98b-86abbc73db54 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:20:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "refresh_cache-91a8e4f6-b0c6-4409-b947-3d687b2d606e" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquired lock "refresh_cache-91a8e4f6-b0c6-4409-b947-3d687b2d606e" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:20:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-396db715-3c2f-4b96-8edf-00d197092fa5 req-149b29db-475b-4115-8d62-1c37faf225c3 service nova] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Received event network-changed-e72b2856-0f6d-4646-b98b-86abbc73db54 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-396db715-3c2f-4b96-8edf-00d197092fa5 req-149b29db-475b-4115-8d62-1c37faf225c3 service nova] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Refreshing instance network info cache due to event network-changed-e72b2856-0f6d-4646-b98b-86abbc73db54. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:20:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-396db715-3c2f-4b96-8edf-00d197092fa5 req-149b29db-475b-4115-8d62-1c37faf225c3 service nova] Acquiring lock "refresh_cache-91a8e4f6-b0c6-4409-b947-3d687b2d606e" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:20:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:20:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:52 user nova-compute[74587]: DEBUG nova.network.neutron [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Updating instance_info_cache with network_info: [{"id": "e72b2856-0f6d-4646-b98b-86abbc73db54", "address": "fa:16:3e:21:5d:b8", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72b2856-0f", "ovs_interfaceid": "e72b2856-0f6d-4646-b98b-86abbc73db54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Releasing lock "refresh_cache-91a8e4f6-b0c6-4409-b947-3d687b2d606e" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Instance network_info: |[{"id": "e72b2856-0f6d-4646-b98b-86abbc73db54", "address": "fa:16:3e:21:5d:b8", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72b2856-0f", "ovs_interfaceid": "e72b2856-0f6d-4646-b98b-86abbc73db54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:20:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-396db715-3c2f-4b96-8edf-00d197092fa5 req-149b29db-475b-4115-8d62-1c37faf225c3 service nova] Acquired lock "refresh_cache-91a8e4f6-b0c6-4409-b947-3d687b2d606e" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:20:52 user nova-compute[74587]: DEBUG nova.network.neutron [req-396db715-3c2f-4b96-8edf-00d197092fa5 req-149b29db-475b-4115-8d62-1c37faf225c3 service nova] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Refreshing network info cache for port e72b2856-0f6d-4646-b98b-86abbc73db54 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:20:52 user nova-compute[74587]: DEBUG nova.network.neutron [req-396db715-3c2f-4b96-8edf-00d197092fa5 req-149b29db-475b-4115-8d62-1c37faf225c3 service nova] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Updated VIF entry in instance network info cache for port e72b2856-0f6d-4646-b98b-86abbc73db54. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:20:52 user nova-compute[74587]: DEBUG nova.network.neutron [req-396db715-3c2f-4b96-8edf-00d197092fa5 req-149b29db-475b-4115-8d62-1c37faf225c3 service nova] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Updating instance_info_cache with network_info: [{"id": "e72b2856-0f6d-4646-b98b-86abbc73db54", "address": "fa:16:3e:21:5d:b8", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72b2856-0f", "ovs_interfaceid": "e72b2856-0f6d-4646-b98b-86abbc73db54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:20:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-396db715-3c2f-4b96-8edf-00d197092fa5 req-149b29db-475b-4115-8d62-1c37faf225c3 service nova] Releasing lock "refresh_cache-91a8e4f6-b0c6-4409-b947-3d687b2d606e" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:20:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:20:54 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Creating image(s)
Oct 18 07:20:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "/opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "/opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "/opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.236s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk 1073741824" returned: 0 in 0.050s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Cannot resize image /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Ensure instance console log exists: /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Start _get_guest_xml network_info=[{"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9fccd833-6c79-4c2d-8107-2059f154b56e', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEKFqhnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '57779903-c965-4099-b4fd-d934e02181dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2af70e1-c57e-41fd-85cc-308b0ae14f17', 'serial': 'e2af70e1-c57e-41fd-85cc-308b0ae14f17'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:20:55 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 18 07:20:55 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.objects.instance [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57779903-c965-4099-b4fd-d934e02181dd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEKFqhnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:20:55 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:20:55 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:20:55 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.utils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[47374f13-9bb6-4068-8945-29d4bfa22255]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:20:55 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7beac54-b717-44e9-a22a-d246542f8263]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c211f473-83f5-4173-8e12-01af017504e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17] added
Oct 18 07:20:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fc761f-33ca-4db1-97e4-bef6a513ff3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e601ce1f-8c1e-4b20-a653-ad1232046101]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[848ece0d-d588-4283-95b5-31b32b50a3b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fb73f0-4cd8-4f34-b8a8-3eb6776892df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cc96d8-5704-4504-a8d0-d0216f4833cc]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEKFqhnZ {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:20:55 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3c65b7-ee3a-4fbd-81d6-93a77ad4753e]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.utils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Updating existing volume attachment record: d4247a6a-1e59-4ca0-be77-89a6ba732047 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEKFqhnZ" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[86307c88-1f61-4d9c-95e3-35d985fdf56d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fEKFqhnZ'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aac0ad-d8f6-425b-9c7f-ca5fc817b18d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd92bad-b78e-416d-a46e-8b3f6f41683a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:20:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:20:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac393310-256c-4e1b-b9c7-10f7891e900a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260]
Oct 18 07:20:55 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260] successful.
Oct 18 07:20:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3b9364-0890-46cd-a48c-45e1f1dd0131]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9489712-ee2c-4bc6-83d6-551993b29143]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:20:55 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:20:55 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] HCTL ('39', '-', '-', 0) found on session 27 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2549b3-13aa-4ad5-911d-00e8c90239f7]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching for a device in session 27 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:20:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEKFqhnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26330383532383737', 'path': '/dev/sdh'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330383532383737', 'path': '/dev/sdh'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-131303816',display_name='tempest-ServerActionsTestOtherA-server-148190764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-131303816',id=21,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtvGfBTkmICl93Y629GSp9vxRmRb7ktS6MkPEYxnd5r5dWprV6nU6Bni5nfUEjdsOZs2O5IEA4YwJeshclRhNFjFWY1pmae36/MF/uwYENjseuyRf+tfHlT2QHevzVfsg==',key_name='tempest-keypair-1663639896',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:18:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-1mfq5t8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:20:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=57779903-c965-4099-b4fd-d934e02181dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:20:56 user nova-compute[74587]:   <uuid>57779903-c965-4099-b4fd-d934e02181dd</uuid>
Oct 18 07:20:56 user nova-compute[74587]:   <name>instance-00000015</name>
Oct 18 07:20:56 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:20:56 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:20:56 user nova-compute[74587]:   <metadata>
Oct 18 07:20:56 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:20:56 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:20:56 user nova-compute[74587]:       <nova:name>tempest-ServerActionsTestOtherA-server-148190764</nova:name>
Oct 18 07:20:56 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:20:55</nova:creationTime>
Oct 18 07:20:56 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:20:56 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:20:56 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:20:56 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:20:56 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:20:56 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:20:56 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:20:56 user nova-compute[74587]:       <nova:owner>
Oct 18 07:20:56 user nova-compute[74587]:         <nova:user uuid="1b1730cd79c54e748232c046b4d3e412">tempest-ServerActionsTestOtherA-2039083727-project-member</nova:user>
Oct 18 07:20:56 user nova-compute[74587]:         <nova:project uuid="196ea516329b4e479bd8f54644007c57">tempest-ServerActionsTestOtherA-2039083727</nova:project>
Oct 18 07:20:56 user nova-compute[74587]:       </nova:owner>
Oct 18 07:20:56 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:20:56 user nova-compute[74587]:       <nova:ports>
Oct 18 07:20:56 user nova-compute[74587]:         <nova:port uuid="deba39b8-e178-4b6a-bf64-6b36d2980719">
Oct 18 07:20:56 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 18 07:20:56 user nova-compute[74587]:         </nova:port>
Oct 18 07:20:56 user nova-compute[74587]:       </nova:ports>
Oct 18 07:20:56 user nova-compute[74587]:     </nova:instance>
Oct 18 07:20:56 user nova-compute[74587]:   </metadata>
Oct 18 07:20:56 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:20:56 user nova-compute[74587]:     <system>
Oct 18 07:20:56 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:20:56 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:20:56 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:20:56 user nova-compute[74587]:       <entry name="serial">57779903-c965-4099-b4fd-d934e02181dd</entry>
Oct 18 07:20:56 user nova-compute[74587]:       <entry name="uuid">57779903-c965-4099-b4fd-d934e02181dd</entry>
Oct 18 07:20:56 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:20:56 user nova-compute[74587]:     </system>
Oct 18 07:20:56 user nova-compute[74587]:   </sysinfo>
Oct 18 07:20:56 user nova-compute[74587]:   <os>
Oct 18 07:20:56 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:20:56 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:20:56 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:20:56 user nova-compute[74587]:   </os>
Oct 18 07:20:56 user nova-compute[74587]:   <features>
Oct 18 07:20:56 user nova-compute[74587]:     <acpi/>
Oct 18 07:20:56 user nova-compute[74587]:     <apic/>
Oct 18 07:20:56 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:20:56 user nova-compute[74587]:   </features>
Oct 18 07:20:56 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:20:56 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:20:56 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:20:56 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:20:56 user nova-compute[74587]:   </clock>
Oct 18 07:20:56 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:20:56 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:20:56 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:20:56 user nova-compute[74587]:   </cpu>
Oct 18 07:20:56 user nova-compute[74587]:   <devices>
Oct 18 07:20:56 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:20:56 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:20:56 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk"/>
Oct 18 07:20:56 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:20:56 user nova-compute[74587]:     </disk>
Oct 18 07:20:56 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:20:56 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:20:56 user nova-compute[74587]:       <source dev="/dev/sdh"/>
Oct 18 07:20:56 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:20:56 user nova-compute[74587]:       <serial>e2af70e1-c57e-41fd-85cc-308b0ae14f17</serial>
Oct 18 07:20:56 user nova-compute[74587]:     </disk>
Oct 18 07:20:56 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:20:56 user nova-compute[74587]:       <mac address="fa:16:3e:e4:25:0d"/>
Oct 18 07:20:56 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:20:56 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:20:56 user nova-compute[74587]:       <target dev="tapdeba39b8-e1"/>
Oct 18 07:20:56 user nova-compute[74587]:     </interface>
Oct 18 07:20:56 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:20:56 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/console.log" append="off"/>
Oct 18 07:20:56 user nova-compute[74587]:     </serial>
Oct 18 07:20:56 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:20:56 user nova-compute[74587]:     <video>
Oct 18 07:20:56 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:20:56 user nova-compute[74587]:     </video>
Oct 18 07:20:56 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:20:56 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:20:56 user nova-compute[74587]:     </rng>
Oct 18 07:20:56 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:20:56 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:20:56 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:20:56 user nova-compute[74587]:     </memballoon>
Oct 18 07:20:56 user nova-compute[74587]:   </devices>
Oct 18 07:20:56 user nova-compute[74587]: </domain>
Oct 18 07:20:56 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-131303816',display_name='tempest-ServerActionsTestOtherA-server-148190764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-131303816',id=21,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtvGfBTkmICl93Y629GSp9vxRmRb7ktS6MkPEYxnd5r5dWprV6nU6Bni5nfUEjdsOZs2O5IEA4YwJeshclRhNFjFWY1pmae36/MF/uwYENjseuyRf+tfHlT2QHevzVfsg==',key_name='tempest-keypair-1663639896',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:18:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-1mfq5t8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:20:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=57779903-c965-4099-b4fd-d934e02181dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG os_vif [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8cb11b7-c066-568a-a2e8-6f211c4bb408', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdeba39b8-e1, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdeba39b8-e1, col_values=(('qos', UUID('11787b04-6fee-47c1-8893-fa2cf2055eb8')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdeba39b8-e1, col_values=(('external_ids', {'iface-id': 'deba39b8-e178-4b6a-bf64-6b36d2980719', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:25:0d', 'vm-uuid': '57779903-c965-4099-b4fd-d934e02181dd'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:20:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:20:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:57 user nova-compute[74587]: INFO os_vif [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1')
Oct 18 07:20:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:20:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:20:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No VIF found with MAC fa:16:3e:e4:25:0d, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:20:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:20:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-fed1c73a-f6e0-4a47-b630-a370f52c13d9 req-8701a719-dca8-4ec0-93ed-962cfc227133 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:20:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fed1c73a-f6e0-4a47-b630-a370f52c13d9 req-8701a719-dca8-4ec0-93ed-962cfc227133 service nova] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:20:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fed1c73a-f6e0-4a47-b630-a370f52c13d9 req-8701a719-dca8-4ec0-93ed-962cfc227133 service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:20:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fed1c73a-f6e0-4a47-b630-a370f52c13d9 req-8701a719-dca8-4ec0-93ed-962cfc227133 service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:20:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-fed1c73a-f6e0-4a47-b630-a370f52c13d9 req-8701a719-dca8-4ec0-93ed-962cfc227133 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] No waiting events found dispatching network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:20:58 user nova-compute[74587]: WARNING nova.compute.manager [req-fed1c73a-f6e0-4a47-b630-a370f52c13d9 req-8701a719-dca8-4ec0-93ed-962cfc227133 service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received unexpected event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 for instance with vm_state active and task_state rebuild_spawning.
Oct 18 07:20:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:21:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Instance spawned successfully.
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:21:00 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 is timed out.
Oct 18 07:21:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Successfully detached device vdb from instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 from the live domain config.
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anLrkbNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:21:00 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-8957e1f5-2881-4502-971c-a06a0d956925 req-876ec9c1-6b9b-4ec7-a431-038099f46a6f service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8957e1f5-2881-4502-971c-a06a0d956925 req-876ec9c1-6b9b-4ec7-a431-038099f46a6f service nova] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8957e1f5-2881-4502-971c-a06a0d956925 req-876ec9c1-6b9b-4ec7-a431-038099f46a6f service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8957e1f5-2881-4502-971c-a06a0d956925 req-876ec9c1-6b9b-4ec7-a431-038099f46a6f service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-8957e1f5-2881-4502-971c-a06a0d956925 req-876ec9c1-6b9b-4ec7-a431-038099f46a6f service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] No waiting events found dispatching network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:21:00 user nova-compute[74587]: WARNING nova.compute.manager [req-8957e1f5-2881-4502-971c-a06a0d956925 req-876ec9c1-6b9b-4ec7-a431-038099f46a6f service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received unexpected event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 for instance with vm_state active and task_state rebuild_spawning.
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[78958698-d1db-40c1-b5f0-6eb5073f5185]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:21:00 user nova-compute[74587]: No targets found.
Oct 18 07:21:00 user nova-compute[74587]: iSNS:
Oct 18 07:21:00 user nova-compute[74587]: No targets found.
Oct 18 07:21:00 user nova-compute[74587]: STATIC:
Oct 18 07:21:00 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f
Oct 18 07:21:00 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:21:00 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:21:00 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17
Oct 18 07:21:00 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:21:00 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:21:00 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:21:00 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:21:00 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:21:00 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51
Oct 18 07:21:00 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:21:00 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:21:00 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:21:00 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:21:00 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:21:00 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a
Oct 18 07:21:00 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:21:00 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:21:00 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3
Oct 18 07:21:00 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:21:00 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:21:00 user nova-compute[74587]: FIRMWARE:
Oct 18 07:21:00 user nova-compute[74587]: No targets found.
Oct 18 07:21:00 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:21:00 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:21:00 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[73016bd7-445f-454c-964e-6033af816ea5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2c99b7-5f70-4fb0-bfce-318547c43c37]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:21:00 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:21:00 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:21:00 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46564d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51'): ({'sde'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Removing single pathed devices sde {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74587) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0344ae-fbea-4bfe-b7a0-1ddb638dfb52]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c70355-5b17-4ca5-ba2b-1cbd6cbe9a7e]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Flushing IO for device /dev/sde {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc0ec57-dd69-4f17-93d8-c865c4e1721c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-561214ba-3dc9-47f0-8d6d-fcd312cd9f34 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[687b246e-3653-4971-9a6a-6ab2b1c0f3bd]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaa23af-ced1-4a75-8da3-e67984129b8b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc423f72-41f0-4b64-8182-02d2db7a4f03]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51, portal: 172.16.0.220,3260]
Oct 18 07:21:00 user nova-compute[74587]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51, portal: 172.16.0.220,3260] successful.
Oct 18 07:21:00 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:21:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e6656c-aaeb-46ff-855f-0427de81cb51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:01 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[393c250e-45ee-4a28-b440-3883722c1f04]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:01 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:21:01 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:21:01 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] <== disconnect_volume: return (344ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:21:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:21:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'flavor' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f388b61e-a113-4404-9245-c14fa8837508 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.279s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.volume.cinder [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Update attachment failed for attachment d4247a6a-1e59-4ca0-be77-89a6ba732047. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b1e0744-adad-4372-8ed5-d29760bdf1fd) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b1e0744-adad-4372-8ed5-d29760bdf1fd)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b1e0744-adad-4372-8ed5-d29760bdf1fd)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Traceback (most recent call last):
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     driver_block_device.attach_block_devices(
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     _log_and_attach(device)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     bdm.attach(*attach_args, **attach_kwargs)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/virt/block_device.py", line 819, in attach
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     super(DriverVolSnapshotBlockDevice, self).attach(
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     ret_val = method(obj, context, *args, **kwargs)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     self._do_attach(context, instance, volume, volume_api,
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     self._volume_attach(context, volume, connector, instance,
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     connection_info = volume_api.attachment_update(
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     res = method(self, ctx, *args, **kwargs)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     with excutils.save_and_reraise_exception():
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     self.force_reraise()
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     raise self.value
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     context, '3.44', skip_version_check=True).attachments.update(
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     return method.func(obj, *args, **kwargs)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     resp = self._update('/attachments/%s' % id, body)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     return self._cs_request(url, 'PUT', **kwargs)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     return self.request(url, method, **kwargs)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e]     raise exceptions.from_response(resp, body)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b1e0744-adad-4372-8ed5-d29760bdf1fd)
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] 
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.compute.claims [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Aborting claim: <nova.compute.claims.Claim object at 0x7f10085e7dc0> {{(pid=74587) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.553s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Build of instance 91a8e4f6-b0c6-4409-b947-3d687b2d606e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b1e0744-adad-4372-8ed5-d29760bdf1fd) {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.compute.utils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Build of instance 91a8e4f6-b0c6-4409-b947-3d687b2d606e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74587) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 18 07:21:02 user nova-compute[74587]: ERROR nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Build of instance 91a8e4f6-b0c6-4409-b947-3d687b2d606e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b1e0744-adad-4372-8ed5-d29760bdf1fd): nova.exception.BuildAbortException: Build of instance 91a8e4f6-b0c6-4409-b947-3d687b2d606e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b1e0744-adad-4372-8ed5-d29760bdf1fd)
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Unplugging VIFs for instance {{(pid=74587) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:20:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2138349955',display_name='tempest-TestVolumeBootPattern-server-2138349955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2138349955',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-7i0kg6p8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:20:50Z,user_data=None,user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=91a8e4f6-b0c6-4409-b947-3d687b2d606e,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e72b2856-0f6d-4646-b98b-86abbc73db54", "address": "fa:16:3e:21:5d:b8", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72b2856-0f", "ovs_interfaceid": "e72b2856-0f6d-4646-b98b-86abbc73db54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "e72b2856-0f6d-4646-b98b-86abbc73db54", "address": "fa:16:3e:21:5d:b8", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72b2856-0f", "ovs_interfaceid": "e72b2856-0f6d-4646-b98b-86abbc73db54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:5d:b8,bridge_name='br-int',has_traffic_filtering=True,id=e72b2856-0f6d-4646-b98b-86abbc73db54,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72b2856-0f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG os_vif [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:5d:b8,bridge_name='br-int',has_traffic_filtering=True,id=e72b2856-0f6d-4646-b98b-86abbc73db54,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72b2856-0f') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape72b2856-0f, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:21:02 user nova-compute[74587]: INFO os_vif [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:5d:b8,bridge_name='br-int',has_traffic_filtering=True,id=e72b2856-0f6d-4646-b98b-86abbc73db54,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72b2856-0f')
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Unplugged VIFs for instance {{(pid=74587) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:21:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:21:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:21:03 user nova-compute[74587]: INFO nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Took 0.57 seconds to deallocate network for instance.
Oct 18 07:21:03 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Detaching volume: 33f1a763-d289-4359-9919-c0f95f456d6c {{(pid=74587) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 18 07:21:03 user nova-compute[74587]: INFO nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Detaching volume 33f1a763-d289-4359-9919-c0f95f456d6c
Oct 18 07:21:03 user nova-compute[74587]: ERROR nova.virt.block_device [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Unable to call for a driver detach of volume 33f1a763-d289-4359-9919-c0f95f456d6c due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance 91a8e4f6-b0c6-4409-b947-3d687b2d606e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b1e0744-adad-4372-8ed5-d29760bdf1fd)
Oct 18 07:21:03 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 91a8e4f6-b0c6-4409-b947-3d687b2d606e] Deleting volume: 33f1a763-d289-4359-9919-c0f95f456d6c {{(pid=74587) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 07:21:03 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Deleted allocations for instance 91a8e4f6-b0c6-4409-b947-3d687b2d606e
Oct 18 07:21:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73c5e942-b7e9-4161-9c35-0984bc1010f4 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "91a8e4f6-b0c6-4409-b947-3d687b2d606e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.153s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:21:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:21:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:21:15 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:21:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:21:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:21:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:21:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:21:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:21:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updating instance_info_cache with network_info: [{"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:21:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:21:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:21:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:21:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:21:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:21:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:21:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:21:24 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:21:24 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7074MB free_disk=24.999332427978516GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 18ce6cb0-9632-4361-8d88-1b751e54ea71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance e82e7877-9569-4a62-9fff-48d4bcca3848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee7e9ad7-fe94-4031-885c-ad134624135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 57779903-c965-4099-b4fd-d934e02181dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance f377ac1a-df76-49e1-b727-916d01a7fd02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 5313fc03-fe27-471c-b0b1-ae9806bbe2a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a61094a5-cbd8-4dd1-9514-d22cffb95d37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance db21a40f-ceef-4c74-949f-80b83c82f1e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:21:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:21:25 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:21:25 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:21:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:21:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:25 user nova-compute[74587]: INFO nova.compute.manager [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Rescuing
Oct 18 07:21:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:21:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquired lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:21:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG nova.network.neutron [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Updating instance_info_cache with network_info: [{"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Releasing lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG nova.compute.manager [req-f8c0c2f0-9e8e-4bb3-af24-e4a51229a9f1 req-4522e1fb-7ccf-4267-a777-c85386375dac service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-unplugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f8c0c2f0-9e8e-4bb3-af24-e4a51229a9f1 req-4522e1fb-7ccf-4267-a777-c85386375dac service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f8c0c2f0-9e8e-4bb3-af24-e4a51229a9f1 req-4522e1fb-7ccf-4267-a777-c85386375dac service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f8c0c2f0-9e8e-4bb3-af24-e4a51229a9f1 req-4522e1fb-7ccf-4267-a777-c85386375dac service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG nova.compute.manager [req-f8c0c2f0-9e8e-4bb3-af24-e4a51229a9f1 req-4522e1fb-7ccf-4267-a777-c85386375dac service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-unplugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:21:26 user nova-compute[74587]: WARNING nova.compute.manager [req-f8c0c2f0-9e8e-4bb3-af24-e4a51229a9f1 req-4522e1fb-7ccf-4267-a777-c85386375dac service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-unplugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state active and task_state rescuing.
Oct 18 07:21:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:26 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Instance destroyed successfully.
Oct 18 07:21:26 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Attempting a stable device rescue
Oct 18 07:21:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74587) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 07:21:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Instance directory exists: not creating {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 07:21:27 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Creating image(s)
Oct 18 07:21:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "/opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "/opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "/opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:27 user nova-compute[74587]: DEBUG nova.objects.instance [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'trusted_certs' on Instance uuid f377ac1a-df76-49e1-b727-916d01a7fd02 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:21:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "3b90917d104e6418230a7ac93bf3d3ac5276648c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "3b90917d104e6418230a7ac93bf3d3ac5276648c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c.part --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c.part --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.virt.images [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] 1c2de0ec-d920-4d27-b1cf-48db09e3e7af was qcow2, converting to raw {{(pid=74587) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c.part /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c.converted {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c.part /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c.converted" returned: 0 in 0.293s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c.converted --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-69a062ed-cda3-4124-b9b4-0f199155ba82 req-692a59c4-9860-49c2-992a-0eed9a4a467d service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69a062ed-cda3-4124-b9b4-0f199155ba82 req-692a59c4-9860-49c2-992a-0eed9a4a467d service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69a062ed-cda3-4124-b9b4-0f199155ba82 req-692a59c4-9860-49c2-992a-0eed9a4a467d service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-69a062ed-cda3-4124-b9b4-0f199155ba82 req-692a59c4-9860-49c2-992a-0eed9a4a467d service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-69a062ed-cda3-4124-b9b4-0f199155ba82 req-692a59c4-9860-49c2-992a-0eed9a4a467d service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:21:28 user nova-compute[74587]: WARNING nova.compute.manager [req-69a062ed-cda3-4124-b9b4-0f199155ba82 req-692a59c4-9860-49c2-992a-0eed9a4a467d service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state active and task_state rescuing.
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "3b90917d104e6418230a7ac93bf3d3ac5276648c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.656s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "3b90917d104e6418230a7ac93bf3d3ac5276648c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "3b90917d104e6418230a7ac93bf3d3ac5276648c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c --force-share --output=json" returned: 0 in 0.168s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c,backing_fmt=raw /opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/disk.rescue {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c,backing_fmt=raw /opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/disk.rescue" returned: 0 in 0.049s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "3b90917d104e6418230a7ac93bf3d3ac5276648c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.objects.instance [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'migration_context' on Instance uuid f377ac1a-df76-49e1-b727-916d01a7fd02 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.objects.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Object Instance<f377ac1a-df76-49e1-b727-916d01a7fd02> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Start _get_guest_xml network_info=[{"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "vif_mac": "fa:16:3e:81:0a:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1c2de0ec-d920-4d27-b1cf-48db09e3e7af', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8d534e75-9099-4eac-aded-fca69ece9e75', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDrmwoAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'f377ac1a-df76-49e1-b727-916d01a7fd02', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab89c35b-81e5-4b3c-8bc9-648be8bf10f1', 'serial': 'ab89c35b-81e5-4b3c-8bc9-648be8bf10f1'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.objects.instance [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'resources' on Instance uuid f377ac1a-df76-49e1-b727-916d01a7fd02 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.objects.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Object Instance<f377ac1a-df76-49e1-b727-916d01a7fd02> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.objects.instance [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'numa_topology' on Instance uuid f377ac1a-df76-49e1-b727-916d01a7fd02 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.objects.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Object Instance<f377ac1a-df76-49e1-b727-916d01a7fd02> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:21:28 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:21:28 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:21:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.objects.instance [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'vcpu_model' on Instance uuid f377ac1a-df76-49e1-b727-916d01a7fd02 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.objects.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Object Instance<f377ac1a-df76-49e1-b727-916d01a7fd02> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDrmwoAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:21:29 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:21:29 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:21:29 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f64eb9-345b-4605-9fc7-600720801ef5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lDrmwoAQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 18 07:21:29 user nova-compute[74587]: node.name = iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:21:29 user nova-compute[74587]: node.tpgt = -1
Oct 18 07:21:29 user nova-compute[74587]: node.startup = automatic
Oct 18 07:21:29 user nova-compute[74587]: node.leading_login = No
Oct 18 07:21:29 user nova-compute[74587]: iface.iscsi_ifacename = default
Oct 18 07:21:29 user nova-compute[74587]: iface.net_ifacename = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.ipaddress = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.prefix_len = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.hwaddress = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.transport_name = tcp
Oct 18 07:21:29 user nova-compute[74587]: iface.initiatorname = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.state = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.vlan_id = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.vlan_priority = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.vlan_state = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.iface_num = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.mtu = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.port = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.bootproto = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.subnet_mask = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.gateway = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.dhcp_alt_client_id_state = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.dhcp_alt_client_id = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.dhcp_dns = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.dhcp_learn_iqn = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.dhcp_req_vendor_id_state = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.dhcp_vendor_id_state = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.dhcp_vendor_id = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.dhcp_slp_da = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.fragmentation = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.gratuitous_arp = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.incoming_forwarding = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.tos_state = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.tos = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.ttl = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.delayed_ack = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.tcp_nagle = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.tcp_wsf_state = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.tcp_wsf = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.tcp_timer_scale = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.tcp_timestamp = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.redirect = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.def_task_mgmt_timeout = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.header_digest = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.data_digest = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.immediate_data = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.initial_r2t = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.data_seq_inorder = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.data_pdu_inorder = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.erl = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.max_receive_data_len = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.first_burst_len = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.max_outstanding_r2t = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.max_burst_len = 0
Oct 18 07:21:29 user nova-compute[74587]: iface.chap_auth = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.bidi_chap = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.strict_login_compliance = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.discovery_auth = <empty>
Oct 18 07:21:29 user nova-compute[74587]: iface.discovery_logout = <empty>
Oct 18 07:21:29 user nova-compute[74587]: node.discovery_address = <empty>
Oct 18 07:21:29 user nova-compute[74587]: node.discovery_port = 0
Oct 18 07:21:29 user nova-compute[74587]: node.discovery_type = static
Oct 18 07:21:29 user nova-compute[74587]: node.session.initial_cmdsn = 0
Oct 18 07:21:29 user nova-compute[74587]: node.session.initial_login_retry_max = 8
Oct 18 07:21:29 user nova-compute[74587]: node.session.xmit_thread_priority = -20
Oct 18 07:21:29 user nova-compute[74587]: node.session.cmds_max = 128
Oct 18 07:21:29 user nova-compute[74587]: node.session.queue_depth = 32
Oct 18 07:21:29 user nova-compute[74587]: node.session.nr_sessions = 1
Oct 18 07:21:29 user nova-compute[74587]: node.session.auth.authmethod = CHAP
Oct 18 07:21:29 user nova-compute[74587]: node.session.auth.username = lDrmwoAQ
Oct 18 07:21:29 user nova-compute[74587]: node.session.auth.password = ***
Oct 18 07:21:29 user nova-compute[74587]: node.session.auth.username_in = <empty>
Oct 18 07:21:29 user nova-compute[74587]: node.session.auth.password_in = <empty>
Oct 18 07:21:29 user nova-compute[74587]: node.session.auth.chap_algs = MD5
Oct 18 07:21:29 user nova-compute[74587]: node.session.timeo.replacement_timeout = 120
Oct 18 07:21:29 user nova-compute[74587]: node.session.err_timeo.abort_timeout = 15
Oct 18 07:21:29 user nova-compute[74587]: node.session.err_timeo.lu_reset_timeout = 30
Oct 18 07:21:29 user nova-compute[74587]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 18 07:21:29 user nova-compute[74587]: node.session.err_timeo.host_reset_timeout = 60
Oct 18 07:21:29 user nova-compute[74587]: node.session.iscsi.FastAbort = Yes
Oct 18 07:21:29 user nova-compute[74587]: node.session.iscsi.InitialR2T = No
Oct 18 07:21:29 user nova-compute[74587]: node.session.iscsi.ImmediateData = Yes
Oct 18 07:21:29 user nova-compute[74587]: node.session.iscsi.FirstBurstLength = 262144
Oct 18 07:21:29 user nova-compute[74587]: node.session.iscsi.MaxBurstLength = 16776192
Oct 18 07:21:29 user nova-compute[74587]: node.session.iscsi.DefaultTime2Retain = 0
Oct 18 07:21:29 user nova-compute[74587]: node.session.iscsi.DefaultTime2Wait = 2
Oct 18 07:21:29 user nova-compute[74587]: node.session.iscsi.MaxConnections = 1
Oct 18 07:21:29 user nova-compute[74587]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 18 07:21:29 user nova-compute[74587]: node.session.iscsi.ERL = 0
Oct 18 07:21:29 user nova-compute[74587]: node.session.scan = manual
Oct 18 07:21:29 user nova-compute[74587]: node.session.reopen_max = 0
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].address = 172.16.0.220
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].port = 3260
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].startup = manual
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].tcp.window_size = 524288
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].tcp.type_of_service = 0
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].timeo.logout_timeout = 15
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].timeo.login_timeout = 15
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].timeo.auth_timeout = 45
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].timeo.noop_out_interval = 5
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].timeo.noop_out_timeout = 5
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].iscsi.HeaderDigest = None
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].iscsi.DataDigest = None
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].iscsi.IFMarker = No
Oct 18 07:21:29 user nova-compute[74587]: node.conn[0].iscsi.OFMarker = No
Oct 18 07:21:29 user nova-compute[74587]: # END RECORD
Oct 18 07:21:29 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f610e8-2bc3-4359-80ca-35ff0fc9c676]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea5de84-6d74-41da-a053-3e35d7fb0c92]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDrmwoAQ {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDrmwoAQ" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2718f684-3bfc-4c80-a01d-3412fbfbeb37]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lDrmwoAQ'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafee10e-2cf3-408b-8791-285faeca2e22]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[70220389-1c48-4571-9a58-b31d97e17af3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:21:29 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:21:29 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:21:29 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:21:29 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:21:29 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:21:29 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:21:29 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:21:29 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:21:29 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:21:29 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:21:29 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:21:29 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] HCTL ('37', '0', '0', 0) found on session 24 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[61467db6-7b3f-47c6-9f6b-6edfdb8dac38]: (4, ('0 0 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Searching for a device in session 24 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDrmwoAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '23733313638646366', 'path': '/dev/sdf'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733313638646366', 'path': '/dev/sdf'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:19:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2083496532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2083496532',id=22,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-bcandgus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:20:19Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=f377ac1a-df76-49e1-b727-916d01a7fd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "vif_mac": "fa:16:3e:81:0a:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "vif_mac": "fa:16:3e:81:0a:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:0a:47,bridge_name='br-int',has_traffic_filtering=True,id=ae030258-2fea-414a-9e11-2db1da2515f4,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae030258-2f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.objects.instance [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'pci_devices' on Instance uuid f377ac1a-df76-49e1-b727-916d01a7fd02 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.objects.base [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Object Instance<f377ac1a-df76-49e1-b727-916d01a7fd02> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:21:29 user nova-compute[74587]:   <uuid>f377ac1a-df76-49e1-b727-916d01a7fd02</uuid>
Oct 18 07:21:29 user nova-compute[74587]:   <name>instance-00000016</name>
Oct 18 07:21:29 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:21:29 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:21:29 user nova-compute[74587]:   <metadata>
Oct 18 07:21:29 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:21:29 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:21:29 user nova-compute[74587]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2083496532</nova:name>
Oct 18 07:21:29 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:21:28</nova:creationTime>
Oct 18 07:21:29 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:21:29 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:21:29 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:21:29 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:21:29 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:21:29 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:21:29 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:21:29 user nova-compute[74587]:       <nova:owner>
Oct 18 07:21:29 user nova-compute[74587]:         <nova:user uuid="e2ca09ce37384d25931eb9a658384255">tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member</nova:user>
Oct 18 07:21:29 user nova-compute[74587]:         <nova:project uuid="c002a125aec54fa388965a9f83cc1624">tempest-ServerBootFromVolumeStableRescueTest-1990729548</nova:project>
Oct 18 07:21:29 user nova-compute[74587]:       </nova:owner>
Oct 18 07:21:29 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:21:29 user nova-compute[74587]:       <nova:ports>
Oct 18 07:21:29 user nova-compute[74587]:         <nova:port uuid="ae030258-2fea-414a-9e11-2db1da2515f4">
Oct 18 07:21:29 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:21:29 user nova-compute[74587]:         </nova:port>
Oct 18 07:21:29 user nova-compute[74587]:       </nova:ports>
Oct 18 07:21:29 user nova-compute[74587]:     </nova:instance>
Oct 18 07:21:29 user nova-compute[74587]:   </metadata>
Oct 18 07:21:29 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:21:29 user nova-compute[74587]:     <system>
Oct 18 07:21:29 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:21:29 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:21:29 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:21:29 user nova-compute[74587]:       <entry name="serial">f377ac1a-df76-49e1-b727-916d01a7fd02</entry>
Oct 18 07:21:29 user nova-compute[74587]:       <entry name="uuid">f377ac1a-df76-49e1-b727-916d01a7fd02</entry>
Oct 18 07:21:29 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:21:29 user nova-compute[74587]:     </system>
Oct 18 07:21:29 user nova-compute[74587]:   </sysinfo>
Oct 18 07:21:29 user nova-compute[74587]:   <os>
Oct 18 07:21:29 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:21:29 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:21:29 user nova-compute[74587]:   </os>
Oct 18 07:21:29 user nova-compute[74587]:   <features>
Oct 18 07:21:29 user nova-compute[74587]:     <acpi/>
Oct 18 07:21:29 user nova-compute[74587]:     <apic/>
Oct 18 07:21:29 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:21:29 user nova-compute[74587]:   </features>
Oct 18 07:21:29 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:21:29 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:21:29 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:21:29 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:21:29 user nova-compute[74587]:   </clock>
Oct 18 07:21:29 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:21:29 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:21:29 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:21:29 user nova-compute[74587]:   </cpu>
Oct 18 07:21:29 user nova-compute[74587]:   <devices>
Oct 18 07:21:29 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:21:29 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:21:29 user nova-compute[74587]:       <source dev="/dev/sdf"/>
Oct 18 07:21:29 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:21:29 user nova-compute[74587]:       <serial>ab89c35b-81e5-4b3c-8bc9-648be8bf10f1</serial>
Oct 18 07:21:29 user nova-compute[74587]:     </disk>
Oct 18 07:21:29 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:21:29 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:21:29 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/disk.rescue"/>
Oct 18 07:21:29 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:21:29 user nova-compute[74587]:       <boot order="1"/>
Oct 18 07:21:29 user nova-compute[74587]:     </disk>
Oct 18 07:21:29 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:21:29 user nova-compute[74587]:       <mac address="fa:16:3e:81:0a:47"/>
Oct 18 07:21:29 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:21:29 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:21:29 user nova-compute[74587]:       <target dev="tapae030258-2f"/>
Oct 18 07:21:29 user nova-compute[74587]:     </interface>
Oct 18 07:21:29 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:21:29 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/console.log" append="off"/>
Oct 18 07:21:29 user nova-compute[74587]:     </serial>
Oct 18 07:21:29 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:21:29 user nova-compute[74587]:     <video>
Oct 18 07:21:29 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:21:29 user nova-compute[74587]:     </video>
Oct 18 07:21:29 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:21:29 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:21:29 user nova-compute[74587]:     </rng>
Oct 18 07:21:29 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:21:29 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:21:29 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:21:29 user nova-compute[74587]:     </memballoon>
Oct 18 07:21:29 user nova-compute[74587]:   </devices>
Oct 18 07:21:29 user nova-compute[74587]: </domain>
Oct 18 07:21:29 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:21:29 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Instance destroyed successfully.
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:21:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] No VIF found with MAC fa:16:3e:81:0a:47, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:30 user nova-compute[74587]: INFO nova.compute.manager [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Terminating instance
Oct 18 07:21:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-afbf18e2-5e08-429d-9de4-6fe423cb3df5 req-7bda3386-c6dc-49c5-8382-25b04476e0d4 service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-afbf18e2-5e08-429d-9de4-6fe423cb3df5 req-7bda3386-c6dc-49c5-8382-25b04476e0d4 service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-afbf18e2-5e08-429d-9de4-6fe423cb3df5 req-7bda3386-c6dc-49c5-8382-25b04476e0d4 service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-afbf18e2-5e08-429d-9de4-6fe423cb3df5 req-7bda3386-c6dc-49c5-8382-25b04476e0d4 service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-afbf18e2-5e08-429d-9de4-6fe423cb3df5 req-7bda3386-c6dc-49c5-8382-25b04476e0d4 service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:21:30 user nova-compute[74587]: WARNING nova.compute.manager [req-afbf18e2-5e08-429d-9de4-6fe423cb3df5 req-7bda3386-c6dc-49c5-8382-25b04476e0d4 service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state active and task_state rescuing.
Oct 18 07:21:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-d7c7b8ba-52ca-45e5-bd7d-833770a81ad2 req-221672bb-fc1e-4a26-96c2-f7d73a79202f service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-unplugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7c7b8ba-52ca-45e5-bd7d-833770a81ad2 req-221672bb-fc1e-4a26-96c2-f7d73a79202f service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7c7b8ba-52ca-45e5-bd7d-833770a81ad2 req-221672bb-fc1e-4a26-96c2-f7d73a79202f service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7c7b8ba-52ca-45e5-bd7d-833770a81ad2 req-221672bb-fc1e-4a26-96c2-f7d73a79202f service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-d7c7b8ba-52ca-45e5-bd7d-833770a81ad2 req-221672bb-fc1e-4a26-96c2-f7d73a79202f service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-unplugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-d7c7b8ba-52ca-45e5-bd7d-833770a81ad2 req-221672bb-fc1e-4a26-96c2-f7d73a79202f service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-unplugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:31 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Instance destroyed successfully.
Oct 18 07:21:31 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lazy-loading 'resources' on Instance uuid 18ce6cb0-9632-4361-8d88-1b751e54ea71 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1309022009',display_name='tempest-ServerStableDeviceRescueTest-server-1309022009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1309022009',id=15,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+HuSZvYMhTBndwoZFDitAG1bWKJbR8Y0n79KIgMy37m08QTWK7X7NI+1SBoM4Fp6cyZHsSfVTcL680PIULqCxeNPzGTuKFRiwq+1/7nMeuNZEWFCcHPbLRFiqo9+0Ing==',key_name='tempest-keypair-1438223812',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:18:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a14b181b13514ad18f0f72adafe71678',ramdisk_id='',reservation_id='r-itjbrbvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1119520504',owner_user_name='tempest-ServerStableDeviceRescueTest-1119520504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc3f0fa71a254ce0857d37a232390e19',uuid=18ce6cb0-9632-4361-8d88-1b751e54ea71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Converting VIF {"id": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "address": "fa:16:3e:db:3e:e9", "network": {"id": "ef9dccd1-142a-452d-9252-573d6561e243", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-901392926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14b181b13514ad18f0f72adafe71678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c9ec21-ce", "ovs_interfaceid": "63c9ec21-cedf-40fb-bb88-137fdb0ada25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:3e:e9,bridge_name='br-int',has_traffic_filtering=True,id=63c9ec21-cedf-40fb-bb88-137fdb0ada25,network=Network(ef9dccd1-142a-452d-9252-573d6561e243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63c9ec21-ce') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG os_vif [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3e:e9,bridge_name='br-int',has_traffic_filtering=True,id=63c9ec21-cedf-40fb-bb88-137fdb0ada25,network=Network(ef9dccd1-142a-452d-9252-573d6561e243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63c9ec21-ce') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63c9ec21-ce, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e574926c-dadd-4cd5-b480-55ef310b1385) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:31 user nova-compute[74587]: INFO os_vif [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:3e:e9,bridge_name='br-int',has_traffic_filtering=True,id=63c9ec21-cedf-40fb-bb88-137fdb0ada25,network=Network(ef9dccd1-142a-452d-9252-573d6561e243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63c9ec21-ce')
Oct 18 07:21:31 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Deleting instance files /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71_del
Oct 18 07:21:31 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Deletion of /opt/stack/data/nova/instances/18ce6cb0-9632-4361-8d88-1b751e54ea71_del complete
Oct 18 07:21:31 user nova-compute[74587]: INFO nova.compute.manager [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 18 07:21:31 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:21:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:32 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:21:32 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Took 0.92 seconds to deallocate network for instance.
Oct 18 07:21:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-1349a03d-7136-4565-8e53-9a91ab942ef4 req-84d6aaf8-adad-4add-b935-965f9a75fac1 service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1349a03d-7136-4565-8e53-9a91ab942ef4 req-84d6aaf8-adad-4add-b935-965f9a75fac1 service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1349a03d-7136-4565-8e53-9a91ab942ef4 req-84d6aaf8-adad-4add-b935-965f9a75fac1 service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1349a03d-7136-4565-8e53-9a91ab942ef4 req-84d6aaf8-adad-4add-b935-965f9a75fac1 service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-1349a03d-7136-4565-8e53-9a91ab942ef4 req-84d6aaf8-adad-4add-b935-965f9a75fac1 service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:21:32 user nova-compute[74587]: WARNING nova.compute.manager [req-1349a03d-7136-4565-8e53-9a91ab942ef4 req-84d6aaf8-adad-4add-b935-965f9a75fac1 service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state active and task_state rescuing.
Oct 18 07:21:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-1349a03d-7136-4565-8e53-9a91ab942ef4 req-84d6aaf8-adad-4add-b935-965f9a75fac1 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-deleted-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-cec5620d-f4cd-4a90-8e42-9bf1116820e9 req-95f7e767-66c6-4244-83f8-1b2fd1f623c0 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cec5620d-f4cd-4a90-8e42-9bf1116820e9 req-95f7e767-66c6-4244-83f8-1b2fd1f623c0 service nova] Acquiring lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cec5620d-f4cd-4a90-8e42-9bf1116820e9 req-95f7e767-66c6-4244-83f8-1b2fd1f623c0 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cec5620d-f4cd-4a90-8e42-9bf1116820e9 req-95f7e767-66c6-4244-83f8-1b2fd1f623c0 service nova] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-cec5620d-f4cd-4a90-8e42-9bf1116820e9 req-95f7e767-66c6-4244-83f8-1b2fd1f623c0 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] No waiting events found dispatching network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:21:33 user nova-compute[74587]: WARNING nova.compute.manager [req-cec5620d-f4cd-4a90-8e42-9bf1116820e9 req-95f7e767-66c6-4244-83f8-1b2fd1f623c0 service nova] [instance: 18ce6cb0-9632-4361-8d88-1b751e54ea71] Received unexpected event network-vif-plugged-63c9ec21-cedf-40fb-bb88-137fdb0ada25 for instance with vm_state deleted and task_state None.
Oct 18 07:21:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-499ff882-ae20-4058-bb57-5acaf84e5358 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:21:33 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:21:33 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:21:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:33 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Deleted allocations for instance 18ce6cb0-9632-4361-8d88-1b751e54ea71
Oct 18 07:21:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5cce854-980d-49d8-8e71-b3af6fb99e97 tempest-ServerStableDeviceRescueTest-1119520504 tempest-ServerStableDeviceRescueTest-1119520504-project-member] Lock "18ce6cb0-9632-4361-8d88-1b751e54ea71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.560s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:21:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:21:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:21:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:21:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-60b4f9a4-eda2-4bf9-927f-0730bd6729f4 req-ebc062a7-3a87-4b50-a2d8-634fe20a4ae6 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received event network-changed-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-60b4f9a4-eda2-4bf9-927f-0730bd6729f4 req-ebc062a7-3a87-4b50-a2d8-634fe20a4ae6 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Refreshing instance network info cache due to event network-changed-0b48f003-8e96-46fd-baf0-ccdee461947b. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-60b4f9a4-eda2-4bf9-927f-0730bd6729f4 req-ebc062a7-3a87-4b50-a2d8-634fe20a4ae6 service nova] Acquiring lock "refresh_cache-5313fc03-fe27-471c-b0b1-ae9806bbe2a7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-60b4f9a4-eda2-4bf9-927f-0730bd6729f4 req-ebc062a7-3a87-4b50-a2d8-634fe20a4ae6 service nova] Acquired lock "refresh_cache-5313fc03-fe27-471c-b0b1-ae9806bbe2a7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG nova.network.neutron [req-60b4f9a4-eda2-4bf9-927f-0730bd6729f4 req-ebc062a7-3a87-4b50-a2d8-634fe20a4ae6 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Refreshing network info cache for port 0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:47 user nova-compute[74587]: INFO nova.compute.manager [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Terminating instance
Oct 18 07:21:47 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG nova.network.neutron [req-60b4f9a4-eda2-4bf9-927f-0730bd6729f4 req-ebc062a7-3a87-4b50-a2d8-634fe20a4ae6 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Updated VIF entry in instance network info cache for port 0b48f003-8e96-46fd-baf0-ccdee461947b. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG nova.network.neutron [req-60b4f9a4-eda2-4bf9-927f-0730bd6729f4 req-ebc062a7-3a87-4b50-a2d8-634fe20a4ae6 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Updating instance_info_cache with network_info: [{"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-60b4f9a4-eda2-4bf9-927f-0730bd6729f4 req-ebc062a7-3a87-4b50-a2d8-634fe20a4ae6 service nova] Releasing lock "refresh_cache-5313fc03-fe27-471c-b0b1-ae9806bbe2a7" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:48 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Instance destroyed successfully.
Oct 18 07:21:48 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'resources' on Instance uuid 5313fc03-fe27-471c-b0b1-ae9806bbe2a7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-246226713',display_name='tempest-AttachVolumeNegativeTest-server-246226713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-246226713',id=23,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgR3fa5HNp8w+jVYMBAaR91VwT8vhIUoI/tfzniGMTxu3TbxaHhAVFvkl1YPhLGE4JhkEI2MlUuG7K5oK/GeGdIRRALAwzutY6jndOZXn7+VrqdYlnL9gq3z80WnGOy7Q==',key_name='tempest-keypair-1121727041',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:20:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-ot745wlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=5313fc03-fe27-471c-b0b1-ae9806bbe2a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "0b48f003-8e96-46fd-baf0-ccdee461947b", "address": "fa:16:3e:2c:e4:f7", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48f003-8e", "ovs_interfaceid": "0b48f003-8e96-46fd-baf0-ccdee461947b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e4:f7,bridge_name='br-int',has_traffic_filtering=True,id=0b48f003-8e96-46fd-baf0-ccdee461947b,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48f003-8e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG os_vif [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e4:f7,bridge_name='br-int',has_traffic_filtering=True,id=0b48f003-8e96-46fd-baf0-ccdee461947b,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48f003-8e') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b48f003-8e, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bd3d9c4-7d60-48ae-91e9-3cc48d31cd27) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:48 user nova-compute[74587]: INFO os_vif [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e4:f7,bridge_name='br-int',has_traffic_filtering=True,id=0b48f003-8e96-46fd-baf0-ccdee461947b,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48f003-8e')
Oct 18 07:21:48 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Deleting instance files /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7_del
Oct 18 07:21:48 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Deletion of /opt/stack/data/nova/instances/5313fc03-fe27-471c-b0b1-ae9806bbe2a7_del complete
Oct 18 07:21:48 user nova-compute[74587]: INFO nova.compute.manager [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 18 07:21:48 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:21:48 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:21:49 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Took 0.74 seconds to deallocate network for instance.
Oct 18 07:21:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-877a57a8-7ee0-41d9-8417-35e3deecbb28 req-5cbac14a-c3cc-4958-888d-d9194f779fd0 service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received event network-vif-deleted-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received event network-vif-unplugged-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] Acquiring lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] No waiting events found dispatching network-vif-unplugged-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received event network-vif-unplugged-0b48f003-8e96-46fd-baf0-ccdee461947b for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received event network-vif-plugged-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] Acquiring lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] No waiting events found dispatching network-vif-plugged-0b48f003-8e96-46fd-baf0-ccdee461947b {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:21:49 user nova-compute[74587]: WARNING nova.compute.manager [req-26f97e5d-2574-443d-aa91-27795b952bd5 req-28b7c14f-f4db-4049-91f8-9dbd8ff7a60a service nova] [instance: 5313fc03-fe27-471c-b0b1-ae9806bbe2a7] Received unexpected event network-vif-plugged-0b48f003-8e96-46fd-baf0-ccdee461947b for instance with vm_state active and task_state deleting.
Oct 18 07:21:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:21:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:49 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Deleted allocations for instance 5313fc03-fe27-471c-b0b1-ae9806bbe2a7
Oct 18 07:21:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0154e6ed-2ac8-4660-ac4f-c016b46298e5 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "5313fc03-fe27-471c-b0b1-ae9806bbe2a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.170s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:21:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG nova.compute.manager [req-4f585ed2-b586-4004-9e63-f2396a6ca139 req-fe0249e0-e566-489d-8da4-4b8e693ba12f service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-changed-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG nova.compute.manager [req-4f585ed2-b586-4004-9e63-f2396a6ca139 req-fe0249e0-e566-489d-8da4-4b8e693ba12f service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Refreshing instance network info cache due to event network-changed-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4f585ed2-b586-4004-9e63-f2396a6ca139 req-fe0249e0-e566-489d-8da4-4b8e693ba12f service nova] Acquiring lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4f585ed2-b586-4004-9e63-f2396a6ca139 req-fe0249e0-e566-489d-8da4-4b8e693ba12f service nova] Acquired lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG nova.network.neutron [req-4f585ed2-b586-4004-9e63-f2396a6ca139 req-fe0249e0-e566-489d-8da4-4b8e693ba12f service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Refreshing network info cache for port 5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:21:54 user nova-compute[74587]: INFO nova.compute.manager [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Detaching volume 94716aab-85c6-4930-8178-e355a0a16be3
Oct 18 07:21:54 user nova-compute[74587]: INFO nova.virt.block_device [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Attempting to driver detach volume 94716aab-85c6-4930-8178-e355a0a16be3 from mountpoint /dev/vdb
Oct 18 07:21:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Attempting to detach device vdb from instance e82e7877-9569-4a62-9fff-48d4bcca3848 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:21:54 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:21:54 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:21:54 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:21:54 user nova-compute[74587]:   <serial>94716aab-85c6-4930-8178-e355a0a16be3</serial>
Oct 18 07:21:54 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:21:54 user nova-compute[74587]: </disk>
Oct 18 07:21:54 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:21:54 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Successfully detached device vdb from instance e82e7877-9569-4a62-9fff-48d4bcca3848 from the persistent domain config.
Oct 18 07:21:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e82e7877-9569-4a62-9fff-48d4bcca3848 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:21:54 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:21:54 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:21:54 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:21:54 user nova-compute[74587]:   <serial>94716aab-85c6-4930-8178-e355a0a16be3</serial>
Oct 18 07:21:54 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:21:54 user nova-compute[74587]: </disk>
Oct 18 07:21:54 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG nova.network.neutron [req-4f585ed2-b586-4004-9e63-f2396a6ca139 req-fe0249e0-e566-489d-8da4-4b8e693ba12f service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updated VIF entry in instance network info cache for port 5a276ea0-c80e-4c21-b65f-6fa7e10c58ba. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG nova.network.neutron [req-4f585ed2-b586-4004-9e63-f2396a6ca139 req-fe0249e0-e566-489d-8da4-4b8e693ba12f service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updating instance_info_cache with network_info: [{"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:21:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4f585ed2-b586-4004-9e63-f2396a6ca139 req-fe0249e0-e566-489d-8da4-4b8e693ba12f service nova] Releasing lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:21:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:21:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-010a4b37-4d26-4865-8e38-896b461ebbd9 req-b23ce604-bc38-4ba8-b4f9-c9fff3e87ccf service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-changed-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:21:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-010a4b37-4d26-4865-8e38-896b461ebbd9 req-b23ce604-bc38-4ba8-b4f9-c9fff3e87ccf service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Refreshing instance network info cache due to event network-changed-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:21:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-010a4b37-4d26-4865-8e38-896b461ebbd9 req-b23ce604-bc38-4ba8-b4f9-c9fff3e87ccf service nova] Acquiring lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:21:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-010a4b37-4d26-4865-8e38-896b461ebbd9 req-b23ce604-bc38-4ba8-b4f9-c9fff3e87ccf service nova] Acquired lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:21:56 user nova-compute[74587]: DEBUG nova.network.neutron [req-010a4b37-4d26-4865-8e38-896b461ebbd9 req-b23ce604-bc38-4ba8-b4f9-c9fff3e87ccf service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Refreshing network info cache for port 5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:21:56 user nova-compute[74587]: DEBUG nova.network.neutron [req-010a4b37-4d26-4865-8e38-896b461ebbd9 req-b23ce604-bc38-4ba8-b4f9-c9fff3e87ccf service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updated VIF entry in instance network info cache for port 5a276ea0-c80e-4c21-b65f-6fa7e10c58ba. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:21:56 user nova-compute[74587]: DEBUG nova.network.neutron [req-010a4b37-4d26-4865-8e38-896b461ebbd9 req-b23ce604-bc38-4ba8-b4f9-c9fff3e87ccf service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updating instance_info_cache with network_info: [{"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:21:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-010a4b37-4d26-4865-8e38-896b461ebbd9 req-b23ce604-bc38-4ba8-b4f9-c9fff3e87ccf service nova] Releasing lock "refresh_cache-e82e7877-9569-4a62-9fff-48d4bcca3848" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:21:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:21:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:22:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:22:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-70b9d62a-c3e3-40a0-963f-ce99568ad150 req-81f032ef-f22d-4158-a4fe-d796e16e60ae service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-changed-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-70b9d62a-c3e3-40a0-963f-ce99568ad150 req-81f032ef-f22d-4158-a4fe-d796e16e60ae service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Refreshing instance network info cache due to event network-changed-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:22:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-70b9d62a-c3e3-40a0-963f-ce99568ad150 req-81f032ef-f22d-4158-a4fe-d796e16e60ae service nova] Acquiring lock "refresh_cache-a61094a5-cbd8-4dd1-9514-d22cffb95d37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:22:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-70b9d62a-c3e3-40a0-963f-ce99568ad150 req-81f032ef-f22d-4158-a4fe-d796e16e60ae service nova] Acquired lock "refresh_cache-a61094a5-cbd8-4dd1-9514-d22cffb95d37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:22:12 user nova-compute[74587]: DEBUG nova.network.neutron [req-70b9d62a-c3e3-40a0-963f-ce99568ad150 req-81f032ef-f22d-4158-a4fe-d796e16e60ae service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Refreshing network info cache for port fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:22:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-70b9d62a-c3e3-40a0-963f-ce99568ad150 req-81f032ef-f22d-4158-a4fe-d796e16e60ae service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Updated VIF entry in instance network info cache for port fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:22:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-70b9d62a-c3e3-40a0-963f-ce99568ad150 req-81f032ef-f22d-4158-a4fe-d796e16e60ae service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Updating instance_info_cache with network_info: [{"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:22:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-70b9d62a-c3e3-40a0-963f-ce99568ad150 req-81f032ef-f22d-4158-a4fe-d796e16e60ae service nova] Releasing lock "refresh_cache-a61094a5-cbd8-4dd1-9514-d22cffb95d37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:22:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:22:13 user nova-compute[74587]: INFO nova.compute.manager [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Rebuilding instance
Oct 18 07:22:13 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-d7239b7e-c324-45fb-a096-680d20750119 req-22f676c0-5eab-4923-93e9-10cb6a0ca3de service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-vif-unplugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7239b7e-c324-45fb-a096-680d20750119 req-22f676c0-5eab-4923-93e9-10cb6a0ca3de service nova] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7239b7e-c324-45fb-a096-680d20750119 req-22f676c0-5eab-4923-93e9-10cb6a0ca3de service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7239b7e-c324-45fb-a096-680d20750119 req-22f676c0-5eab-4923-93e9-10cb6a0ca3de service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-d7239b7e-c324-45fb-a096-680d20750119 req-22f676c0-5eab-4923-93e9-10cb6a0ca3de service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] No waiting events found dispatching network-vif-unplugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:22:14 user nova-compute[74587]: WARNING nova.compute.manager [req-d7239b7e-c324-45fb-a096-680d20750119 req-22f676c0-5eab-4923-93e9-10cb6a0ca3de service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received unexpected event network-vif-unplugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 for instance with vm_state active and task_state rebuilding.
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:22:14 user nova-compute[74587]: INFO nova.compute.claims [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Claim successful on node user
Oct 18 07:22:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Instance destroyed successfully.
Oct 18 07:22:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Instance destroyed successfully.
Oct 18 07:22:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-608502183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1188491975',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb7AWTCUJMtWT+b6CO+0sC3i+/8jyR2wEzLDh9dRK0WqLzka8rM6W/97aV9qlO5Rr3hf8np+xqTDyEmyct3btj/WZrRH3GWfTzWe8m6/GmXDuKx72pEDYM8Ze3f2yy1+Q==',key_name='tempest-keypair-1211237030',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:20:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99d9c959e5f6494d82b4fae0fb9123f3',ramdisk_id='',reservation_id='r-x8yh5wgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-474901938',owner_user_name='tempest-ServerActionsV293TestJSON-474901938-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d72c3d757ed49adafd674fb5ee1e44f',uuid=a61094a5-cbd8-4dd1-9514-d22cffb95d37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converting VIF {"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_vif [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc4ce1ba-92, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b75174c7-a077-4614-bef6-a4755f3d846d) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:14 user nova-compute[74587]: INFO os_vif [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92')
Oct 18 07:22:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuGrcIVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:22:14 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[650cb991-2577-4153-beb5-aeab3580e2f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:22:14 user nova-compute[74587]: No targets found.
Oct 18 07:22:14 user nova-compute[74587]: iSNS:
Oct 18 07:22:14 user nova-compute[74587]: No targets found.
Oct 18 07:22:14 user nova-compute[74587]: STATIC:
Oct 18 07:22:14 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f
Oct 18 07:22:14 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:14 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:14 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17
Oct 18 07:22:14 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:14 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:14 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:22:14 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:14 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:14 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:22:14 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:14 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:14 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a
Oct 18 07:22:14 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:14 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:14 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3
Oct 18 07:22:14 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:14 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:14 user nova-compute[74587]: FIRMWARE:
Oct 18 07:22:14 user nova-compute[74587]: No targets found.
Oct 18 07:22:14 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:22:14 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:22:14 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b528b2-ce9f-4e85-815d-d431108add39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[20911d45-a395-45f1-8d4b-c6894dfe4e29]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:14 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:22:14 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:14 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:14 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:22:14 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:14 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:14 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:22:14 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:14 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:14 user nova-compute[74587]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:22:14 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:14 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10082bdb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a'): ({'sdg'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Removing single pathed devices sdg {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe64780-ab79-485e-a0a3-9b9e3a6bc6ba]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d8a8da-d365-4653-b058-a79a443b7716]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Flushing IO for device /dev/sdg {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d291878d-2ac2-4419-b3ab-f3962749328c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a514a0c-b227-4a5e-bb1f-1127e40e85ac]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] SCSI volumes sdg have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6a985b-f226-4b11-bd58-edaf04a71e98]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a635533-e7b0-4d6c-8418-24a241ef3245]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260]
Oct 18 07:22:15 user nova-compute[74587]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260] successful.
Oct 18 07:22:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[17732472-2bd8-408a-86d2-20ca8f97e580]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] <== disconnect_volume: return (333ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:22:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Deleting instance files /opt/stack/data/nova/instances/a61094a5-cbd8-4dd1-9514-d22cffb95d37_del
Oct 18 07:22:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Deletion of /opt/stack/data/nova/instances/a61094a5-cbd8-4dd1-9514-d22cffb95d37_del complete
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:22:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:22:15 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e82e7877-9569-4a62-9fff-48d4bcca3848 is timed out.
Oct 18 07:22:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Successfully detached device vdb from instance e82e7877-9569-4a62-9fff-48d4bcca3848 from the live domain config.
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKwUOrpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:22:15 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance a61094a5-cbd8-4dd1-9514-d22cffb95d37 could not be found.
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuGrcIVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:22:15 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.policy [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd13de789e98e4ba9ad22d665ff8e4ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cfa00773ba4c5498c56b84ccb307a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:22:15 user nova-compute[74587]: INFO nova.virt.block_device [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Booting with volume 133181fc-3f6a-4380-a2a3-220f3193a3da at /dev/vda
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4163b2ff-c3b9-49c1-9b27-91777ee49cb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:22:15 user nova-compute[74587]: No targets found.
Oct 18 07:22:15 user nova-compute[74587]: iSNS:
Oct 18 07:22:15 user nova-compute[74587]: No targets found.
Oct 18 07:22:15 user nova-compute[74587]: STATIC:
Oct 18 07:22:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f
Oct 18 07:22:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17
Oct 18 07:22:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:22:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:22:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3
Oct 18 07:22:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:15 user nova-compute[74587]: FIRMWARE:
Oct 18 07:22:15 user nova-compute[74587]: No targets found.
Oct 18 07:22:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:22:15 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:22:15 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d018e6-e955-49d5-a471-4b10946b2d07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5701660e-a295-41ae-8939-54d053de1f7e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10082bf370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3'): ({'sdd'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Removing single pathed devices sdd {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.utils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2b6073-373b-4412-bf87-b02054741e0d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbe73fe-492f-4f7e-83eb-04185abd3d6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[248c4284-36c2-4b2c-9492-8714c915dee7]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Flushing IO for device /dev/sdd {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c74303-fa2e-4c3e-88e8-82354b4fc54d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fc9571-aaa0-4c95-b2a4-bd6e7c58d57d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[231eb9c6-039d-45be-85bf-778abddc5550]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0728e82-3205-4c19-8677-581921f925df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28204f8-5f35-4f55-b1a3-38c401c82eb6]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:22:15 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b22c68-1ba1-46c3-94ba-302642f6a1e6]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.utils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Updating existing volume attachment record: ee6f8e50-c0b3-4859-a666-93dfd1f8a635 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614c6ff-0e72-4665-b5e4-91d1a2b4d08c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[55623df0-268d-4978-9e2f-ae2725fbe4f7]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3, portal: 172.16.0.220,3260]
Oct 18 07:22:15 user nova-compute[74587]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3, portal: 172.16.0.220,3260] successful.
Oct 18 07:22:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94716aab-85c6-4930-8178-e355a0a16be3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[98452e28-8e34-4ed1-9ea9-65ef3b5f0e88]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] <== disconnect_volume: return (356ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.343s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e36cf-abe4-47f1-9cb7-2565d7b848b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:22:15 user nova-compute[74587]: No targets found.
Oct 18 07:22:15 user nova-compute[74587]: iSNS:
Oct 18 07:22:15 user nova-compute[74587]: No targets found.
Oct 18 07:22:15 user nova-compute[74587]: STATIC:
Oct 18 07:22:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f
Oct 18 07:22:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17
Oct 18 07:22:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:22:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:22:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:15 user nova-compute[74587]: FIRMWARE:
Oct 18 07:22:15 user nova-compute[74587]: No targets found.
Oct 18 07:22:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:22:15 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:22:15 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[55550654-9fe2-47d9-b760-3dc264fb1f26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbe0197-4a8d-4f27-8a82-6eb5c02478c1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:15 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f100832fc70>, {}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Disconnecting from: [] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] <== disconnect_volume: return (421ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:22:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Successfully created port: 84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-03354f29-d6fe-4bec-bdb3-bb278672fd0c req-64159d0c-61da-4d8f-b510-2111528f1ef5 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-03354f29-d6fe-4bec-bdb3-bb278672fd0c req-64159d0c-61da-4d8f-b510-2111528f1ef5 service nova] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-03354f29-d6fe-4bec-bdb3-bb278672fd0c req-64159d0c-61da-4d8f-b510-2111528f1ef5 service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-03354f29-d6fe-4bec-bdb3-bb278672fd0c req-64159d0c-61da-4d8f-b510-2111528f1ef5 service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-03354f29-d6fe-4bec-bdb3-bb278672fd0c req-64159d0c-61da-4d8f-b510-2111528f1ef5 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] No waiting events found dispatching network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:22:16 user nova-compute[74587]: WARNING nova.compute.manager [req-03354f29-d6fe-4bec-bdb3-bb278672fd0c req-64159d0c-61da-4d8f-b510-2111528f1ef5 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received unexpected event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 for instance with vm_state active and task_state rebuilding.
Oct 18 07:22:16 user nova-compute[74587]: DEBUG nova.objects.instance [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'flavor' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7864e371-83e5-4220-8d9e-55e678a72242 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.866s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Successfully updated port: 84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Preparing to wait for external event volume-reimaged-17848046-ec39-4558-aee8-75180f56091a {{(pid=74587) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "refresh_cache-af696b6e-6fc7-44ee-a514-c49f6f6b340a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquired lock "refresh_cache-af696b6e-6fc7-44ee-a514-c49f6f6b340a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-355e8261-da65-4f9b-a715-7d695e32ea61 req-2f876d5c-e4d4-4c66-8669-f4dd178645cb service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received event network-changed-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-355e8261-da65-4f9b-a715-7d695e32ea61 req-2f876d5c-e4d4-4c66-8669-f4dd178645cb service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Refreshing instance network info cache due to event network-changed-84e29791-fdbb-48a2-962e-514b20c0dbe9. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-355e8261-da65-4f9b-a715-7d695e32ea61 req-2f876d5c-e4d4-4c66-8669-f4dd178645cb service nova] Acquiring lock "refresh_cache-af696b6e-6fc7-44ee-a514-c49f6f6b340a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:22:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:22:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Updating instance_info_cache with network_info: [{"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:22:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Releasing lock "refresh_cache-af696b6e-6fc7-44ee-a514-c49f6f6b340a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:22:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Instance network_info: |[{"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:22:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-355e8261-da65-4f9b-a715-7d695e32ea61 req-2f876d5c-e4d4-4c66-8669-f4dd178645cb service nova] Acquired lock "refresh_cache-af696b6e-6fc7-44ee-a514-c49f6f6b340a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:22:17 user nova-compute[74587]: DEBUG nova.network.neutron [req-355e8261-da65-4f9b-a715-7d695e32ea61 req-2f876d5c-e4d4-4c66-8669-f4dd178645cb service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Refreshing network info cache for port 84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:22:17 user nova-compute[74587]: DEBUG nova.network.neutron [req-355e8261-da65-4f9b-a715-7d695e32ea61 req-2f876d5c-e4d4-4c66-8669-f4dd178645cb service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Updated VIF entry in instance network info cache for port 84e29791-fdbb-48a2-962e-514b20c0dbe9. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:22:17 user nova-compute[74587]: DEBUG nova.network.neutron [req-355e8261-da65-4f9b-a715-7d695e32ea61 req-2f876d5c-e4d4-4c66-8669-f4dd178645cb service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Updating instance_info_cache with network_info: [{"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:22:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-355e8261-da65-4f9b-a715-7d695e32ea61 req-2f876d5c-e4d4-4c66-8669-f4dd178645cb service nova] Releasing lock "refresh_cache-af696b6e-6fc7-44ee-a514-c49f6f6b340a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:22:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:22:19 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:22:19 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:22:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:22:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:22:19 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:22:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updating instance_info_cache with network_info: [{"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-d9651223-0963-4247-ab2b-48f42efb1dc8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:22:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:25 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:22:25 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7614MB free_disk=25.051898956298828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance e82e7877-9569-4a62-9fff-48d4bcca3848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee7e9ad7-fe94-4031-885c-ad134624135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 57779903-c965-4099-b4fd-d934e02181dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance f377ac1a-df76-49e1-b727-916d01a7fd02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a61094a5-cbd8-4dd1-9514-d22cffb95d37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance db21a40f-ceef-4c74-949f-80b83c82f1e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance af696b6e-6fc7-44ee-a514-c49f6f6b340a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:22:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-d504bcf3-a44d-4816-b42a-eadceaf65185 req-e5110759-0e87-4d5b-b222-a90df74ad4b5 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-changed-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-d504bcf3-a44d-4816-b42a-eadceaf65185 req-e5110759-0e87-4d5b-b222-a90df74ad4b5 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Refreshing instance network info cache due to event network-changed-6b0a10ff-6fe0-4564-b1ea-29cc81f01924. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:22:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d504bcf3-a44d-4816-b42a-eadceaf65185 req-e5110759-0e87-4d5b-b222-a90df74ad4b5 service nova] Acquiring lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:22:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d504bcf3-a44d-4816-b42a-eadceaf65185 req-e5110759-0e87-4d5b-b222-a90df74ad4b5 service nova] Acquired lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:22:27 user nova-compute[74587]: DEBUG nova.network.neutron [req-d504bcf3-a44d-4816-b42a-eadceaf65185 req-e5110759-0e87-4d5b-b222-a90df74ad4b5 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Refreshing network info cache for port 6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:22:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:22:27 user nova-compute[74587]: DEBUG nova.network.neutron [req-d504bcf3-a44d-4816-b42a-eadceaf65185 req-e5110759-0e87-4d5b-b222-a90df74ad4b5 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updated VIF entry in instance network info cache for port 6b0a10ff-6fe0-4564-b1ea-29cc81f01924. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:22:27 user nova-compute[74587]: DEBUG nova.network.neutron [req-d504bcf3-a44d-4816-b42a-eadceaf65185 req-e5110759-0e87-4d5b-b222-a90df74ad4b5 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updating instance_info_cache with network_info: [{"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:22:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d504bcf3-a44d-4816-b42a-eadceaf65185 req-e5110759-0e87-4d5b-b222-a90df74ad4b5 service nova] Releasing lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:22:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:33 user nova-compute[74587]: INFO nova.compute.manager [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Shelving
Oct 18 07:22:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-019abce9-39c2-4526-a134-e66361e7b0a8 req-4375d58f-feda-4ae4-985c-e6c71d6dd7ed service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-vif-unplugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-019abce9-39c2-4526-a134-e66361e7b0a8 req-4375d58f-feda-4ae4-985c-e6c71d6dd7ed service nova] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-019abce9-39c2-4526-a134-e66361e7b0a8 req-4375d58f-feda-4ae4-985c-e6c71d6dd7ed service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-019abce9-39c2-4526-a134-e66361e7b0a8 req-4375d58f-feda-4ae4-985c-e6c71d6dd7ed service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-019abce9-39c2-4526-a134-e66361e7b0a8 req-4375d58f-feda-4ae4-985c-e6c71d6dd7ed service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] No waiting events found dispatching network-vif-unplugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:22:33 user nova-compute[74587]: WARNING nova.compute.manager [req-019abce9-39c2-4526-a134-e66361e7b0a8 req-4375d58f-feda-4ae4-985c-e6c71d6dd7ed service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received unexpected event network-vif-unplugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 for instance with vm_state active and task_state shelving.
Oct 18 07:22:34 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Instance destroyed successfully.
Oct 18 07:22:34 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Beginning cold snapshot process
Oct 18 07:22:34 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:22:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk /opt/stack/data/nova/instances/snapshots/tmpk86q3596/f0bc2955ab1c43bca7ac9f116a67aaaf {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk /opt/stack/data/nova/instances/snapshots/tmpk86q3596/f0bc2955ab1c43bca7ac9f116a67aaaf" returned: 0 in 1.129s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:35 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Snapshot extracted, beginning image upload
Oct 18 07:22:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-0338c7aa-5711-429e-980f-37498287c7a8 req-e9d441d1-e8b1-4ecc-bdc7-7dfc1c5fc596 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0338c7aa-5711-429e-980f-37498287c7a8 req-e9d441d1-e8b1-4ecc-bdc7-7dfc1c5fc596 service nova] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0338c7aa-5711-429e-980f-37498287c7a8 req-e9d441d1-e8b1-4ecc-bdc7-7dfc1c5fc596 service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0338c7aa-5711-429e-980f-37498287c7a8 req-e9d441d1-e8b1-4ecc-bdc7-7dfc1c5fc596 service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-0338c7aa-5711-429e-980f-37498287c7a8 req-e9d441d1-e8b1-4ecc-bdc7-7dfc1c5fc596 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] No waiting events found dispatching network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:22:35 user nova-compute[74587]: WARNING nova.compute.manager [req-0338c7aa-5711-429e-980f-37498287c7a8 req-e9d441d1-e8b1-4ecc-bdc7-7dfc1c5fc596 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received unexpected event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 for instance with vm_state active and task_state shelving_image_uploading.
Oct 18 07:22:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Snapshot image upload complete
Oct 18 07:22:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:22:38 user nova-compute[74587]: INFO nova.compute.manager [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Shelve offloading
Oct 18 07:22:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Instance destroyed successfully.
Oct 18 07:22:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:22:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:22:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquired lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:22:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:22:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updating instance_info_cache with network_info: [{"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:22:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Releasing lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:39 user nova-compute[74587]: INFO nova.compute.manager [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Detaching volume f6534655-a00b-4812-975a-7f07f677f77f
Oct 18 07:22:39 user nova-compute[74587]: INFO nova.virt.block_device [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Attempting to driver detach volume f6534655-a00b-4812-975a-7f07f677f77f from mountpoint /dev/vdb
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Attempting to detach device vdb from instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:22:39 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:22:39 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:22:39 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:22:39 user nova-compute[74587]:   <serial>f6534655-a00b-4812-975a-7f07f677f77f</serial>
Oct 18 07:22:39 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:22:39 user nova-compute[74587]: </disk>
Oct 18 07:22:39 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:22:39 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully detached device vdb from instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db from the persistent domain config.
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:22:39 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:22:39 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:22:39 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:22:39 user nova-compute[74587]:   <serial>f6534655-a00b-4812-975a-7f07f677f77f</serial>
Oct 18 07:22:39 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:22:39 user nova-compute[74587]: </disk>
Oct 18 07:22:39 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:22:39 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Instance destroyed successfully.
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.objects.instance [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'resources' on Instance uuid db21a40f-ceef-4c74-949f-80b83c82f1e5 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1244513542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1244513542',id=25,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy2/cWP8WQ1La5/QKuL3jYChPeN0VPAAZ3nrF6uVf9b1QBGYXd0EDBi2DmgRL39gFo910hg16O6gyhq3Su5lGILbUf2jiLTF5VIlvuS+se1aJqzZiOC2YYW1GdUWIn5/w==',key_name='tempest-keypair-1932888942',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-y1fpij3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member',shelved_at='2023-10-18T07:22:38.282467',shelved_host='user',shelved_image_id='347a56e0-4d2c-411b-9695-23356f80f1ed'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:22:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=db21a40f-ceef-4c74-949f-80b83c82f1e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG os_vif [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b0a10ff-6f, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9c4796a-e459-49cd-9a25-42a1be2c8104) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-7f378a9f-9f8b-458c-b727-358224e1c484 req-f046f0be-7f6f-4263-bb1e-1c9542b6089b service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-changed-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-7f378a9f-9f8b-458c-b727-358224e1c484 req-f046f0be-7f6f-4263-bb1e-1c9542b6089b service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Refreshing instance network info cache due to event network-changed-6b0a10ff-6fe0-4564-b1ea-29cc81f01924. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7f378a9f-9f8b-458c-b727-358224e1c484 req-f046f0be-7f6f-4263-bb1e-1c9542b6089b service nova] Acquiring lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7f378a9f-9f8b-458c-b727-358224e1c484 req-f046f0be-7f6f-4263-bb1e-1c9542b6089b service nova] Acquired lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.network.neutron [req-7f378a9f-9f8b-458c-b727-358224e1c484 req-f046f0be-7f6f-4263-bb1e-1c9542b6089b service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Refreshing network info cache for port 6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:22:39 user nova-compute[74587]: INFO os_vif [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f')
Oct 18 07:22:39 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Deleting instance files /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5_del
Oct 18 07:22:39 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Deletion of /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5_del complete
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:22:39 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Deleted allocations for instance db21a40f-ceef-4c74-949f-80b83c82f1e5
Oct 18 07:22:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.objects.instance [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'numa_topology' on Instance uuid db21a40f-ceef-4c74-949f-80b83c82f1e5 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:22:39 user nova-compute[74587]: DEBUG nova.objects.base [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Object Instance<db21a40f-ceef-4c74-949f-80b83c82f1e5> lazy-loaded attributes: resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:22:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-7f378a9f-9f8b-458c-b727-358224e1c484 req-f046f0be-7f6f-4263-bb1e-1c9542b6089b service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updated VIF entry in instance network info cache for port 6b0a10ff-6fe0-4564-b1ea-29cc81f01924. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:22:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-7f378a9f-9f8b-458c-b727-358224e1c484 req-f046f0be-7f6f-4263-bb1e-1c9542b6089b service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updating instance_info_cache with network_info: [{"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:22:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7f378a9f-9f8b-458c-b727-358224e1c484 req-f046f0be-7f6f-4263-bb1e-1c9542b6089b service nova] Releasing lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:22:40 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:22:40 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:22:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bd591bc3-3b0a-49e1-9281-d4eef93fe1b7 tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.070s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-d679a3e6-7efc-4967-93f3-7985f5405d2f req-dba6216c-9381-49e6-8471-0851fb52aff6 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event volume-reimaged-17848046-ec39-4558-aee8-75180f56091a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d679a3e6-7efc-4967-93f3-7985f5405d2f req-dba6216c-9381-49e6-8471-0851fb52aff6 service nova] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d679a3e6-7efc-4967-93f3-7985f5405d2f req-dba6216c-9381-49e6-8471-0851fb52aff6 service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d679a3e6-7efc-4967-93f3-7985f5405d2f req-dba6216c-9381-49e6-8471-0851fb52aff6 service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-d679a3e6-7efc-4967-93f3-7985f5405d2f req-dba6216c-9381-49e6-8471-0851fb52aff6 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Processing event volume-reimaged-17848046-ec39-4558-aee8-75180f56091a {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Instance event wait completed in 26 seconds for volume-reimaged {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:22:43 user nova-compute[74587]: INFO nova.virt.block_device [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Booting with volume 17848046-ec39-4558-aee8-75180f56091a at /dev/vda
Oct 18 07:22:43 user nova-compute[74587]: DEBUG os_brick.utils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[584c9e1e-39a3-433f-a18c-07267db5a69f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[951c3e57-03b2-4175-a175-32c4b5f91e38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e930a061-c9f2-42c7-9a1d-b4a8e9f60f63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d346006-2772-4d31-a863-f606f68ec82e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:22:43 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:22:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf17ee6-5460-4b80-b50f-96316cf2ca9a]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG os_brick.utils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:22:43 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Updating existing volume attachment record: f8cada32-4511-451c-82b9-6ee447b73f43 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:22:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:45 user nova-compute[74587]: INFO nova.compute.manager [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Terminating instance
Oct 18 07:22:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-55a938d9-5332-450a-b92d-2ee4ec78ce70 req-9bcfbca0-a797-46d8-98ff-52e6a2af7f49 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-unplugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-55a938d9-5332-450a-b92d-2ee4ec78ce70 req-9bcfbca0-a797-46d8-98ff-52e6a2af7f49 service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-55a938d9-5332-450a-b92d-2ee4ec78ce70 req-9bcfbca0-a797-46d8-98ff-52e6a2af7f49 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-55a938d9-5332-450a-b92d-2ee4ec78ce70 req-9bcfbca0-a797-46d8-98ff-52e6a2af7f49 service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-55a938d9-5332-450a-b92d-2ee4ec78ce70 req-9bcfbca0-a797-46d8-98ff-52e6a2af7f49 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-unplugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-55a938d9-5332-450a-b92d-2ee4ec78ce70 req-9bcfbca0-a797-46d8-98ff-52e6a2af7f49 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-unplugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:45 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Instance destroyed successfully.
Oct 18 07:22:45 user nova-compute[74587]: DEBUG nova.objects.instance [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'resources' on Instance uuid e82e7877-9569-4a62-9fff-48d4bcca3848 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-356048251',display_name='tempest-ServerRescueNegativeTestJSON-server-356048251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-356048251',id=17,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5wq4FSXcSbqJDyU+OCrgV4Dw18pW88quoCGsPjcRGFr/Vma5g8ZVmcXLz7dQcu8B5T0mLVa+LScc0/X9fEMYB00IwJr46Pm9jpd4R0eouPbrfgia1GPucA9GEpLtdq5Q==',key_name='tempest-keypair-2077577956',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:18:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-h5kpvvnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:20:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96efd41052434514aea7fe47a5eb36f7',uuid=e82e7877-9569-4a62-9fff-48d4bcca3848,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "address": "fa:16:3e:bd:d8:17", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a276ea0-c8", "ovs_interfaceid": "5a276ea0-c80e-4c21-b65f-6fa7e10c58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d8:17,bridge_name='br-int',has_traffic_filtering=True,id=5a276ea0-c80e-4c21-b65f-6fa7e10c58ba,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a276ea0-c8') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG os_vif [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d8:17,bridge_name='br-int',has_traffic_filtering=True,id=5a276ea0-c80e-4c21-b65f-6fa7e10c58ba,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a276ea0-c8') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a276ea0-c8, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9adee4bb-8e0e-4694-b5db-a07365064ba2) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:22:45 user nova-compute[74587]: INFO os_vif [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d8:17,bridge_name='br-int',has_traffic_filtering=True,id=5a276ea0-c80e-4c21-b65f-6fa7e10c58ba,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a276ea0-c8')
Oct 18 07:22:45 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Deleting instance files /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848_del
Oct 18 07:22:45 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Deletion of /opt/stack/data/nova/instances/e82e7877-9569-4a62-9fff-48d4bcca3848_del complete
Oct 18 07:22:46 user nova-compute[74587]: INFO nova.compute.manager [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 18 07:22:46 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:22:46 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:22:46 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:22:46 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:22:46 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Took 1.00 seconds to deallocate network for instance.
Oct 18 07:22:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-843af8f1-dcab-4609-8211-ecb9a1b74211 req-5752b0e2-2f4b-4b5f-9137-aee3a695ef49 service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-deleted-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:47 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:22:47 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:22:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:47 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Deleted allocations for instance e82e7877-9569-4a62-9fff-48d4bcca3848
Oct 18 07:22:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-7b859e9d-bc0c-4e3a-b5e1-3665e41bcddb req-7f605272-ea38-4262-9d7c-756a9214131c service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7b859e9d-bc0c-4e3a-b5e1-3665e41bcddb req-7f605272-ea38-4262-9d7c-756a9214131c service nova] Acquiring lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7b859e9d-bc0c-4e3a-b5e1-3665e41bcddb req-7f605272-ea38-4262-9d7c-756a9214131c service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7b859e9d-bc0c-4e3a-b5e1-3665e41bcddb req-7f605272-ea38-4262-9d7c-756a9214131c service nova] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-7b859e9d-bc0c-4e3a-b5e1-3665e41bcddb req-7f605272-ea38-4262-9d7c-756a9214131c service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] No waiting events found dispatching network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:22:47 user nova-compute[74587]: WARNING nova.compute.manager [req-7b859e9d-bc0c-4e3a-b5e1-3665e41bcddb req-7f605272-ea38-4262-9d7c-756a9214131c service nova] [instance: e82e7877-9569-4a62-9fff-48d4bcca3848] Received unexpected event network-vif-plugged-5a276ea0-c80e-4c21-b65f-6fa7e10c58ba for instance with vm_state deleted and task_state None.
Oct 18 07:22:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9a3eb41f-e4e6-4977-b5b1-37a58ba79d42 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "e82e7877-9569-4a62-9fff-48d4bcca3848" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.426s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:22:56 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Creating image(s)
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Ensure instance console log exists: /opt/stack/data/nova/instances/af696b6e-6fc7-44ee-a514-c49f6f6b340a/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Start _get_guest_xml network_info=[{"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ee6f8e50-c0b3-4859-a666-93dfd1f8a635', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdJkCYrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af696b6e-6fc7-44ee-a514-c49f6f6b340a', 'attached_at': '', 'detached_at': '', 'volume_id': '133181fc-3f6a-4380-a2a3-220f3193a3da', 'serial': '133181fc-3f6a-4380-a2a3-220f3193a3da'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:22:56 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:22:56 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdJkCYrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:22:56 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:22:56 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:22:56 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[96deea87-fb20-44ef-8a87-346afd7c29fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:22:56 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f82d3b-c302-4f4a-8bc3-bafe0497e725]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da] added
Oct 18 07:22:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6294a3a6-062e-4026-bf13-927aa31a5f3b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f741a4-20a1-41c5-9fcb-9c5a93413164]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdJkCYrz {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdJkCYrz" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d48bbae-8ca0-448d-b867-356f65b85bf3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bdJkCYrz'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[244d77cb-ca28-4ad7-a214-df116e8e0879]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[407746b5-4e8e-4be4-8f62-ca40e41fbf7c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10f3ff4-4422-4e43-abf5-65966ed3745b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da, portal: 172.16.0.220,3260]
Oct 18 07:22:56 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da, portal: 172.16.0.220,3260] successful.
Oct 18 07:22:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[053de9e3-d0d0-4c5d-86d2-89a185b04e43]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f4654-d00a-4668-86bd-d62e4187ecc4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:22:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:56 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:22:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd05f4e-f8b0-4307-ac46-74f2dd6f1f84]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:22:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdJkCYrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:22:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:22:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26665303165356139', 'path': '/dev/sdd'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:22:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665303165356139', 'path': '/dev/sdd'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-725973808',display_name='tempest-TestVolumeBootPattern-volume-backed-server-725973808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-725973808',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxWLJWTmIftgMAKabxgyEjLPxRbxevs/sT4nXwAuzg+ACBUBxk37r0dRG20p3t+64VeM+tUXqL/zTcL+WuTe9nFjKh+REt8GRORoZKxixPV3AShBlZzoWsjG4qxM+EblQ==',key_name='tempest-keypair-877730637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-mhu04t50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=af696b6e-6fc7-44ee-a514-c49f6f6b340a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=84e29791-fdbb-48a2-962e-514b20c0dbe9,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e29791-fd') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG nova.objects.instance [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lazy-loading 'pci_devices' on Instance uuid af696b6e-6fc7-44ee-a514-c49f6f6b340a {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:22:58 user nova-compute[74587]:   <uuid>af696b6e-6fc7-44ee-a514-c49f6f6b340a</uuid>
Oct 18 07:22:58 user nova-compute[74587]:   <name>instance-0000001b</name>
Oct 18 07:22:58 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:22:58 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:22:58 user nova-compute[74587]:   <metadata>
Oct 18 07:22:58 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:22:58 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:22:58 user nova-compute[74587]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-725973808</nova:name>
Oct 18 07:22:58 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:22:56</nova:creationTime>
Oct 18 07:22:58 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:22:58 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:22:58 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:22:58 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:22:58 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:22:58 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:22:58 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:22:58 user nova-compute[74587]:       <nova:owner>
Oct 18 07:22:58 user nova-compute[74587]:         <nova:user uuid="d13de789e98e4ba9ad22d665ff8e4ddd">tempest-TestVolumeBootPattern-1301266373-project-member</nova:user>
Oct 18 07:22:58 user nova-compute[74587]:         <nova:project uuid="f1cfa00773ba4c5498c56b84ccb307a9">tempest-TestVolumeBootPattern-1301266373</nova:project>
Oct 18 07:22:58 user nova-compute[74587]:       </nova:owner>
Oct 18 07:22:58 user nova-compute[74587]:       <nova:ports>
Oct 18 07:22:58 user nova-compute[74587]:         <nova:port uuid="84e29791-fdbb-48a2-962e-514b20c0dbe9">
Oct 18 07:22:58 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 18 07:22:58 user nova-compute[74587]:         </nova:port>
Oct 18 07:22:58 user nova-compute[74587]:       </nova:ports>
Oct 18 07:22:58 user nova-compute[74587]:     </nova:instance>
Oct 18 07:22:58 user nova-compute[74587]:   </metadata>
Oct 18 07:22:58 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:22:58 user nova-compute[74587]:     <system>
Oct 18 07:22:58 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:22:58 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:22:58 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:22:58 user nova-compute[74587]:       <entry name="serial">af696b6e-6fc7-44ee-a514-c49f6f6b340a</entry>
Oct 18 07:22:58 user nova-compute[74587]:       <entry name="uuid">af696b6e-6fc7-44ee-a514-c49f6f6b340a</entry>
Oct 18 07:22:58 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:22:58 user nova-compute[74587]:     </system>
Oct 18 07:22:58 user nova-compute[74587]:   </sysinfo>
Oct 18 07:22:58 user nova-compute[74587]:   <os>
Oct 18 07:22:58 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:22:58 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:22:58 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:22:58 user nova-compute[74587]:   </os>
Oct 18 07:22:58 user nova-compute[74587]:   <features>
Oct 18 07:22:58 user nova-compute[74587]:     <acpi/>
Oct 18 07:22:58 user nova-compute[74587]:     <apic/>
Oct 18 07:22:58 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:22:58 user nova-compute[74587]:   </features>
Oct 18 07:22:58 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:22:58 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:22:58 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:22:58 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:22:58 user nova-compute[74587]:   </clock>
Oct 18 07:22:58 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:22:58 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:22:58 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:22:58 user nova-compute[74587]:   </cpu>
Oct 18 07:22:58 user nova-compute[74587]:   <devices>
Oct 18 07:22:58 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:22:58 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:22:58 user nova-compute[74587]:       <source dev="/dev/sdd"/>
Oct 18 07:22:58 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:22:58 user nova-compute[74587]:       <serial>133181fc-3f6a-4380-a2a3-220f3193a3da</serial>
Oct 18 07:22:58 user nova-compute[74587]:     </disk>
Oct 18 07:22:58 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:22:58 user nova-compute[74587]:       <mac address="fa:16:3e:6d:f0:4b"/>
Oct 18 07:22:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:22:58 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:22:58 user nova-compute[74587]:       <target dev="tap84e29791-fd"/>
Oct 18 07:22:58 user nova-compute[74587]:     </interface>
Oct 18 07:22:58 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:22:58 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/af696b6e-6fc7-44ee-a514-c49f6f6b340a/console.log" append="off"/>
Oct 18 07:22:58 user nova-compute[74587]:     </serial>
Oct 18 07:22:58 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:22:58 user nova-compute[74587]:     <video>
Oct 18 07:22:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:22:58 user nova-compute[74587]:     </video>
Oct 18 07:22:58 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:22:58 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:22:58 user nova-compute[74587]:     </rng>
Oct 18 07:22:58 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:22:58 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:22:58 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:22:58 user nova-compute[74587]:     </memballoon>
Oct 18 07:22:58 user nova-compute[74587]:   </devices>
Oct 18 07:22:58 user nova-compute[74587]: </domain>
Oct 18 07:22:58 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-725973808',display_name='tempest-TestVolumeBootPattern-volume-backed-server-725973808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-725973808',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxWLJWTmIftgMAKabxgyEjLPxRbxevs/sT4nXwAuzg+ACBUBxk37r0dRG20p3t+64VeM+tUXqL/zTcL+WuTe9nFjKh+REt8GRORoZKxixPV3AShBlZzoWsjG4qxM+EblQ==',key_name='tempest-keypair-877730637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-mhu04t50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=af696b6e-6fc7-44ee-a514-c49f6f6b340a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=84e29791-fdbb-48a2-962e-514b20c0dbe9,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e29791-fd') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG os_vif [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=84e29791-fdbb-48a2-962e-514b20c0dbe9,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e29791-fd') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2247f8df-e8f1-5a8f-af67-0fcb2f43bc90', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84e29791-fd, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84e29791-fd, col_values=(('qos', UUID('7c46384e-06a7-4395-8397-3bd7e6889bd1')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84e29791-fd, col_values=(('external_ids', {'iface-id': '84e29791-fdbb-48a2-962e-514b20c0dbe9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:f0:4b', 'vm-uuid': 'af696b6e-6fc7-44ee-a514-c49f6f6b340a'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:58 user nova-compute[74587]: INFO os_vif [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=84e29791-fdbb-48a2-962e-514b20c0dbe9,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e29791-fd')
Oct 18 07:22:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:22:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] No VIF found with MAC fa:16:3e:6d:f0:4b, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:22:59 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db is timed out.
Oct 18 07:22:59 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully detached device vdb from instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db from the live domain config.
Oct 18 07:22:59 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nivrjKmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:22:59 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3388ed39-013d-4a5a-a744-0c6b4ce28438]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:22:59 user nova-compute[74587]: No targets found.
Oct 18 07:22:59 user nova-compute[74587]: iSNS:
Oct 18 07:22:59 user nova-compute[74587]: No targets found.
Oct 18 07:22:59 user nova-compute[74587]: STATIC:
Oct 18 07:22:59 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f
Oct 18 07:22:59 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:59 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:59 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17
Oct 18 07:22:59 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:59 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:59 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:22:59 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:59 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:59 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da
Oct 18 07:22:59 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:59 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:59 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:22:59 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:22:59 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:22:59 user nova-compute[74587]: FIRMWARE:
Oct 18 07:22:59 user nova-compute[74587]: No targets found.
Oct 18 07:22:59 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:22:59 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:22:59 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d6a3aa-2396-4733-91d8-109b7659cccc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2473ccf8-82bd-426a-8276-8ade14ec156e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:59 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:59 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:59 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:59 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:22:59 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:22:59 user nova-compute[74587]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f (non-flash)
Oct 18 07:22:59 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:22:59 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:22:59 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:22:59 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10082bfe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-3d4db486-903a-4948-b153-039575a14297 req-62c0d689-8931-4356-9bf8-089958951fbd service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received event network-vif-plugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3d4db486-903a-4948-b153-039575a14297 req-62c0d689-8931-4356-9bf8-089958951fbd service nova] Acquiring lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3d4db486-903a-4948-b153-039575a14297 req-62c0d689-8931-4356-9bf8-089958951fbd service nova] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3d4db486-903a-4948-b153-039575a14297 req-62c0d689-8931-4356-9bf8-089958951fbd service nova] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-3d4db486-903a-4948-b153-039575a14297 req-62c0d689-8931-4356-9bf8-089958951fbd service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] No waiting events found dispatching network-vif-plugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:22:59 user nova-compute[74587]: WARNING nova.compute.manager [req-3d4db486-903a-4948-b153-039575a14297 req-62c0d689-8931-4356-9bf8-089958951fbd service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received unexpected event network-vif-plugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 for instance with vm_state building and task_state spawning.
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7df10f-638c-477f-b1d5-2a02b37f5721]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53d3eb9-32b2-4dfb-8ad5-74baa90a6e01]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67f3da5-cee5-459d-a4bb-11a89296fc41]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa45902-cd8c-42b4-953c-73089488d6d4]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:22:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f2a2ea-539c-4b6c-a6ee-d8cedd48f4ea]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dfc559-8a26-4eb4-be30-3aad75813bf5]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f, portal: 172.16.0.220,3260]
Oct 18 07:23:00 user nova-compute[74587]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f, portal: 172.16.0.220,3260] successful.
Oct 18 07:23:00 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6534655-a00b-4812-975a-7f07f677f77f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6358275-f240-4d6a-af8f-1ebfb76b45f8]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] <== disconnect_volume: return (398ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'flavor' on Instance uuid b1c2c7fb-7f42-49df-9d7b-706dffa5a6db {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-89b437d4-f48b-4468-8f6f-c0b2234382aa tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.850s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:23:01 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Instance spawned successfully.
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:01 user nova-compute[74587]: INFO nova.compute.manager [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:23:01 user nova-compute[74587]: INFO nova.compute.manager [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Took 47.26 seconds to build instance.
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-088f426e-eaf7-495f-acfc-e58d9089ec77 req-527f1ebb-3522-4269-96f0-3f812f723fe0 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received event network-vif-plugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-088f426e-eaf7-495f-acfc-e58d9089ec77 req-527f1ebb-3522-4269-96f0-3f812f723fe0 service nova] Acquiring lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-088f426e-eaf7-495f-acfc-e58d9089ec77 req-527f1ebb-3522-4269-96f0-3f812f723fe0 service nova] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-088f426e-eaf7-495f-acfc-e58d9089ec77 req-527f1ebb-3522-4269-96f0-3f812f723fe0 service nova] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-088f426e-eaf7-495f-acfc-e58d9089ec77 req-527f1ebb-3522-4269-96f0-3f812f723fe0 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] No waiting events found dispatching network-vif-plugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:01 user nova-compute[74587]: WARNING nova.compute.manager [req-088f426e-eaf7-495f-acfc-e58d9089ec77 req-527f1ebb-3522-4269-96f0-3f812f723fe0 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received unexpected event network-vif-plugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 for instance with vm_state active and task_state None.
Oct 18 07:23:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824d5632-5822-4fcc-876f-4525bf95b639 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.367s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "665a2f6d-4704-400e-aeca-ae8cb29333da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:23:09 user nova-compute[74587]: INFO nova.compute.claims [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Claim successful on node user
Oct 18 07:23:09 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG nova.network.neutron [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:23:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:23:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG nova.policy [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '968bb444a9524dab94f28aa7ffab2305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e52872350444fd954e9fea9743b118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:23:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Creating image(s)
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "/opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "/opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "/opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk 1073741824" returned: 0 in 0.066s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.network.neutron [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Successfully created port: 4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.235s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Cannot resize image /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Ensure instance console log exists: /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:23:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Creating image(s)
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Ensure instance console log exists: /opt/stack/data/nova/instances/a61094a5-cbd8-4dd1-9514-d22cffb95d37/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Start _get_guest_xml network_info=[{"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f8cada32-4511-451c-82b9-6ee447b73f43', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuGrcIVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a61094a5-cbd8-4dd1-9514-d22cffb95d37', 'attached_at': '', 'detached_at': '', 'volume_id': '17848046-ec39-4558-aee8-75180f56091a', 'serial': '17848046-ec39-4558-aee8-75180f56091a'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:23:10 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 18 07:23:10 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.objects.instance [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lazy-loading 'vcpu_model' on Instance uuid a61094a5-cbd8-4dd1-9514-d22cffb95d37 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuGrcIVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:23:10 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 07:23:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:23:10 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 07:23:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:23:10 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[627674b1-53dc-45cd-9665-f09e24d2766f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:23:10 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc66a32-f19a-4482-a0f7-6984857b1625]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a] added
Oct 18 07:23:10 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[575ada01-dadd-414f-bed9-bf86532f8bd7]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c79d3-d996-48c7-aae3-e8fae86dbaf8]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CuGrcIVt {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CuGrcIVt" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc43026d-2626-487a-b7fa-999e215870ce]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CuGrcIVt'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff14f0a6-37a4-4497-89d5-d3245afe8b75]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[563786b2-ca27-4c20-84b6-bc431c425cc5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:23:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:23:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Successfully updated port: 4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquired lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b538171-1706-438a-909b-3667296a6722]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260]
Oct 18 07:23:11 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260] successful.
Oct 18 07:23:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-2d010fde-5887-4eeb-acbd-07a5f61f816c req-20f9f885-c947-4887-8982-ce2ff824cad8 service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Received event network-changed-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-2d010fde-5887-4eeb-acbd-07a5f61f816c req-20f9f885-c947-4887-8982-ce2ff824cad8 service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Refreshing instance network info cache due to event network-changed-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2d010fde-5887-4eeb-acbd-07a5f61f816c req-20f9f885-c947-4887-8982-ce2ff824cad8 service nova] Acquiring lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[256e589c-4354-4b22-8af9-303e3682e5ca]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef68b59a-2ce3-4e80-a80c-c709dee9d016]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:23:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:23:11 user nova-compute[74587]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:23:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bff8b3-5991-4091-82ae-22b185758556]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuGrcIVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Updating instance_info_cache with network_info: [{"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Releasing lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Instance network_info: |[{"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2d010fde-5887-4eeb-acbd-07a5f61f816c req-20f9f885-c947-4887-8982-ce2ff824cad8 service nova] Acquired lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.network.neutron [req-2d010fde-5887-4eeb-acbd-07a5f61f816c req-20f9f885-c947-4887-8982-ce2ff824cad8 service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Refreshing network info cache for port 4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Start _get_guest_xml network_info=[{"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:23:11 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:23:11 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-958590571',display_name='tempest-ServersNegativeTestJSON-server-958590571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-958590571',id=28,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e52872350444fd954e9fea9743b118',ramdisk_id='',reservation_id='r-2m852wxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-766120743',owner_user_name='tempest-ServersNegativeTestJSON-766120743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:23:10Z,user_data=None,user_id='968bb444a9524dab94f28aa7ffab2305',uuid=665a2f6d-4704-400e-aeca-ae8cb29333da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converting VIF {"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:47:37,bridge_name='br-int',has_traffic_filtering=True,id=4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4efaf64a-1e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lazy-loading 'pci_devices' on Instance uuid 665a2f6d-4704-400e-aeca-ae8cb29333da {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:23:11 user nova-compute[74587]:   <uuid>665a2f6d-4704-400e-aeca-ae8cb29333da</uuid>
Oct 18 07:23:11 user nova-compute[74587]:   <name>instance-0000001c</name>
Oct 18 07:23:11 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:23:11 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:23:11 user nova-compute[74587]:   <metadata>
Oct 18 07:23:11 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:23:11 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:23:11 user nova-compute[74587]:       <nova:name>tempest-ServersNegativeTestJSON-server-958590571</nova:name>
Oct 18 07:23:11 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:23:11</nova:creationTime>
Oct 18 07:23:11 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:23:11 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:23:11 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:23:11 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:23:11 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:23:11 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:23:11 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:23:11 user nova-compute[74587]:       <nova:owner>
Oct 18 07:23:11 user nova-compute[74587]:         <nova:user uuid="968bb444a9524dab94f28aa7ffab2305">tempest-ServersNegativeTestJSON-766120743-project-member</nova:user>
Oct 18 07:23:11 user nova-compute[74587]:         <nova:project uuid="88e52872350444fd954e9fea9743b118">tempest-ServersNegativeTestJSON-766120743</nova:project>
Oct 18 07:23:11 user nova-compute[74587]:       </nova:owner>
Oct 18 07:23:11 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:23:11 user nova-compute[74587]:       <nova:ports>
Oct 18 07:23:11 user nova-compute[74587]:         <nova:port uuid="4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c">
Oct 18 07:23:11 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 18 07:23:11 user nova-compute[74587]:         </nova:port>
Oct 18 07:23:11 user nova-compute[74587]:       </nova:ports>
Oct 18 07:23:11 user nova-compute[74587]:     </nova:instance>
Oct 18 07:23:11 user nova-compute[74587]:   </metadata>
Oct 18 07:23:11 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:23:11 user nova-compute[74587]:     <system>
Oct 18 07:23:11 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:23:11 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:23:11 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:23:11 user nova-compute[74587]:       <entry name="serial">665a2f6d-4704-400e-aeca-ae8cb29333da</entry>
Oct 18 07:23:11 user nova-compute[74587]:       <entry name="uuid">665a2f6d-4704-400e-aeca-ae8cb29333da</entry>
Oct 18 07:23:11 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:23:11 user nova-compute[74587]:     </system>
Oct 18 07:23:11 user nova-compute[74587]:   </sysinfo>
Oct 18 07:23:11 user nova-compute[74587]:   <os>
Oct 18 07:23:11 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:23:11 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:23:11 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:23:11 user nova-compute[74587]:   </os>
Oct 18 07:23:11 user nova-compute[74587]:   <features>
Oct 18 07:23:11 user nova-compute[74587]:     <acpi/>
Oct 18 07:23:11 user nova-compute[74587]:     <apic/>
Oct 18 07:23:11 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:23:11 user nova-compute[74587]:   </features>
Oct 18 07:23:11 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:23:11 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:23:11 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:23:11 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:23:11 user nova-compute[74587]:   </clock>
Oct 18 07:23:11 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:23:11 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:23:11 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:23:11 user nova-compute[74587]:   </cpu>
Oct 18 07:23:11 user nova-compute[74587]:   <devices>
Oct 18 07:23:11 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:23:11 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:23:11 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk"/>
Oct 18 07:23:11 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:23:11 user nova-compute[74587]:     </disk>
Oct 18 07:23:11 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:23:11 user nova-compute[74587]:       <mac address="fa:16:3e:3c:47:37"/>
Oct 18 07:23:11 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:23:11 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:23:11 user nova-compute[74587]:       <target dev="tap4efaf64a-1e"/>
Oct 18 07:23:11 user nova-compute[74587]:     </interface>
Oct 18 07:23:11 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:23:11 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/console.log" append="off"/>
Oct 18 07:23:11 user nova-compute[74587]:     </serial>
Oct 18 07:23:11 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:23:11 user nova-compute[74587]:     <video>
Oct 18 07:23:11 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:23:11 user nova-compute[74587]:     </video>
Oct 18 07:23:11 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:23:11 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:23:11 user nova-compute[74587]:     </rng>
Oct 18 07:23:11 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:23:11 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:23:11 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:23:11 user nova-compute[74587]:     </memballoon>
Oct 18 07:23:11 user nova-compute[74587]:   </devices>
Oct 18 07:23:11 user nova-compute[74587]: </domain>
Oct 18 07:23:11 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-958590571',display_name='tempest-ServersNegativeTestJSON-server-958590571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-958590571',id=28,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e52872350444fd954e9fea9743b118',ramdisk_id='',reservation_id='r-2m852wxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-766120743',owner_user_name='tempest-ServersNegativeTestJSON-766120743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:23:10Z,user_data=None,user_id='968bb444a9524dab94f28aa7ffab2305',uuid=665a2f6d-4704-400e-aeca-ae8cb29333da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converting VIF {"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:47:37,bridge_name='br-int',has_traffic_filtering=True,id=4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4efaf64a-1e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG os_vif [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:47:37,bridge_name='br-int',has_traffic_filtering=True,id=4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4efaf64a-1e') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf1f7715-e696-54bf-9dc9-bc0904bc6a9b', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4efaf64a-1e, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4efaf64a-1e, col_values=(('qos', UUID('9053e85e-e03a-4626-8576-f44c0600a091')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4efaf64a-1e, col_values=(('external_ids', {'iface-id': '4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:47:37', 'vm-uuid': '665a2f6d-4704-400e-aeca-ae8cb29333da'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:11 user nova-compute[74587]: INFO os_vif [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:47:37,bridge_name='br-int',has_traffic_filtering=True,id=4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4efaf64a-1e')
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:23:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] No VIF found with MAC fa:16:3e:3c:47:37, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.network.neutron [req-2d010fde-5887-4eeb-acbd-07a5f61f816c req-20f9f885-c947-4887-8982-ce2ff824cad8 service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Updated VIF entry in instance network info cache for port 4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.network.neutron [req-2d010fde-5887-4eeb-acbd-07a5f61f816c req-20f9f885-c947-4887-8982-ce2ff824cad8 service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Updating instance_info_cache with network_info: [{"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2d010fde-5887-4eeb-acbd-07a5f61f816c req-20f9f885-c947-4887-8982-ce2ff824cad8 service nova] Releasing lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23130633338323831', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130633338323831', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-608502183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1188491975',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb7AWTCUJMtWT+b6CO+0sC3i+/8jyR2wEzLDh9dRK0WqLzka8rM6W/97aV9qlO5Rr3hf8np+xqTDyEmyct3btj/WZrRH3GWfTzWe8m6/GmXDuKx72pEDYM8Ze3f2yy1+Q==',key_name='tempest-keypair-1211237030',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:20:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99d9c959e5f6494d82b4fae0fb9123f3',ramdisk_id='',reservation_id='r-x8yh5wgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-474901938',owner_user_name='tempest-ServerActionsV293TestJSON-474901938-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d72c3d757ed49adafd674fb5ee1e44f',uuid=a61094a5-cbd8-4dd1-9514-d22cffb95d37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converting VIF {"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:23:12 user nova-compute[74587]:   <uuid>a61094a5-cbd8-4dd1-9514-d22cffb95d37</uuid>
Oct 18 07:23:12 user nova-compute[74587]:   <name>instance-00000018</name>
Oct 18 07:23:12 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:23:12 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:23:12 user nova-compute[74587]:   <metadata>
Oct 18 07:23:12 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:23:12 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:23:12 user nova-compute[74587]:       <nova:name>tempest-ServerActionsV293TestJSON-server-608502183</nova:name>
Oct 18 07:23:12 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:23:10</nova:creationTime>
Oct 18 07:23:12 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:23:12 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:23:12 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:23:12 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:23:12 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:23:12 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:23:12 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:23:12 user nova-compute[74587]:       <nova:owner>
Oct 18 07:23:12 user nova-compute[74587]:         <nova:user uuid="4d72c3d757ed49adafd674fb5ee1e44f">tempest-ServerActionsV293TestJSON-474901938-project-member</nova:user>
Oct 18 07:23:12 user nova-compute[74587]:         <nova:project uuid="99d9c959e5f6494d82b4fae0fb9123f3">tempest-ServerActionsV293TestJSON-474901938</nova:project>
Oct 18 07:23:12 user nova-compute[74587]:       </nova:owner>
Oct 18 07:23:12 user nova-compute[74587]:       <nova:ports>
Oct 18 07:23:12 user nova-compute[74587]:         <nova:port uuid="fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2">
Oct 18 07:23:12 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:23:12 user nova-compute[74587]:         </nova:port>
Oct 18 07:23:12 user nova-compute[74587]:       </nova:ports>
Oct 18 07:23:12 user nova-compute[74587]:     </nova:instance>
Oct 18 07:23:12 user nova-compute[74587]:   </metadata>
Oct 18 07:23:12 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:23:12 user nova-compute[74587]:     <system>
Oct 18 07:23:12 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:23:12 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:23:12 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:23:12 user nova-compute[74587]:       <entry name="serial">a61094a5-cbd8-4dd1-9514-d22cffb95d37</entry>
Oct 18 07:23:12 user nova-compute[74587]:       <entry name="uuid">a61094a5-cbd8-4dd1-9514-d22cffb95d37</entry>
Oct 18 07:23:12 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:23:12 user nova-compute[74587]:     </system>
Oct 18 07:23:12 user nova-compute[74587]:   </sysinfo>
Oct 18 07:23:12 user nova-compute[74587]:   <os>
Oct 18 07:23:12 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:23:12 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:23:12 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:23:12 user nova-compute[74587]:   </os>
Oct 18 07:23:12 user nova-compute[74587]:   <features>
Oct 18 07:23:12 user nova-compute[74587]:     <acpi/>
Oct 18 07:23:12 user nova-compute[74587]:     <apic/>
Oct 18 07:23:12 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:23:12 user nova-compute[74587]:   </features>
Oct 18 07:23:12 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:23:12 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:23:12 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:23:12 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:23:12 user nova-compute[74587]:   </clock>
Oct 18 07:23:12 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:23:12 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:23:12 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:23:12 user nova-compute[74587]:   </cpu>
Oct 18 07:23:12 user nova-compute[74587]:   <devices>
Oct 18 07:23:12 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:23:12 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:23:12 user nova-compute[74587]:       <source dev="/dev/sdb"/>
Oct 18 07:23:12 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:23:12 user nova-compute[74587]:       <serial>17848046-ec39-4558-aee8-75180f56091a</serial>
Oct 18 07:23:12 user nova-compute[74587]:     </disk>
Oct 18 07:23:12 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:23:12 user nova-compute[74587]:       <mac address="fa:16:3e:ec:4b:38"/>
Oct 18 07:23:12 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:23:12 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:23:12 user nova-compute[74587]:       <target dev="tapfc4ce1ba-92"/>
Oct 18 07:23:12 user nova-compute[74587]:     </interface>
Oct 18 07:23:12 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:23:12 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/a61094a5-cbd8-4dd1-9514-d22cffb95d37/console.log" append="off"/>
Oct 18 07:23:12 user nova-compute[74587]:     </serial>
Oct 18 07:23:12 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:23:12 user nova-compute[74587]:     <video>
Oct 18 07:23:12 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:23:12 user nova-compute[74587]:     </video>
Oct 18 07:23:12 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:23:12 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:23:12 user nova-compute[74587]:     </rng>
Oct 18 07:23:12 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:23:12 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:23:12 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:23:12 user nova-compute[74587]:     </memballoon>
Oct 18 07:23:12 user nova-compute[74587]:   </devices>
Oct 18 07:23:12 user nova-compute[74587]: </domain>
Oct 18 07:23:12 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-608502183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1188491975',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb7AWTCUJMtWT+b6CO+0sC3i+/8jyR2wEzLDh9dRK0WqLzka8rM6W/97aV9qlO5Rr3hf8np+xqTDyEmyct3btj/WZrRH3GWfTzWe8m6/GmXDuKx72pEDYM8Ze3f2yy1+Q==',key_name='tempest-keypair-1211237030',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:20:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99d9c959e5f6494d82b4fae0fb9123f3',ramdisk_id='',reservation_id='r-x8yh5wgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-474901938',owner_user_name='tempest-ServerActionsV293TestJSON-474901938-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d72c3d757ed49adafd674fb5ee1e44f',uuid=a61094a5-cbd8-4dd1-9514-d22cffb95d37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converting VIF {"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG os_vif [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95067b99-8f72-5ce6-b117-a62c49e815cb', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc4ce1ba-92, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc4ce1ba-92, col_values=(('qos', UUID('efc9a2f2-a478-4034-b610-b24a7128bd70')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc4ce1ba-92, col_values=(('external_ids', {'iface-id': 'fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:4b:38', 'vm-uuid': 'a61094a5-cbd8-4dd1-9514-d22cffb95d37'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:12 user nova-compute[74587]: INFO os_vif [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92')
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:23:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] No VIF found with MAC fa:16:3e:ec:4b:38, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:23:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-ca51c799-d840-4614-8b1b-8a03775cd0a3 req-82bd5a1e-c22a-4c09-9155-6cf1819a7de9 service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Received event network-vif-plugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ca51c799-d840-4614-8b1b-8a03775cd0a3 req-82bd5a1e-c22a-4c09-9155-6cf1819a7de9 service nova] Acquiring lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ca51c799-d840-4614-8b1b-8a03775cd0a3 req-82bd5a1e-c22a-4c09-9155-6cf1819a7de9 service nova] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ca51c799-d840-4614-8b1b-8a03775cd0a3 req-82bd5a1e-c22a-4c09-9155-6cf1819a7de9 service nova] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-ca51c799-d840-4614-8b1b-8a03775cd0a3 req-82bd5a1e-c22a-4c09-9155-6cf1819a7de9 service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] No waiting events found dispatching network-vif-plugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:13 user nova-compute[74587]: WARNING nova.compute.manager [req-ca51c799-d840-4614-8b1b-8a03775cd0a3 req-82bd5a1e-c22a-4c09-9155-6cf1819a7de9 service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Received unexpected event network-vif-plugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c for instance with vm_state building and task_state spawning.
Oct 18 07:23:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-4912d4b5-f197-4421-b088-1a809f1743e9 req-ca8ce78c-afee-4647-9fbd-d8828d53204f service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4912d4b5-f197-4421-b088-1a809f1743e9 req-ca8ce78c-afee-4647-9fbd-d8828d53204f service nova] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4912d4b5-f197-4421-b088-1a809f1743e9 req-ca8ce78c-afee-4647-9fbd-d8828d53204f service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4912d4b5-f197-4421-b088-1a809f1743e9 req-ca8ce78c-afee-4647-9fbd-d8828d53204f service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-4912d4b5-f197-4421-b088-1a809f1743e9 req-ca8ce78c-afee-4647-9fbd-d8828d53204f service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] No waiting events found dispatching network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:14 user nova-compute[74587]: WARNING nova.compute.manager [req-4912d4b5-f197-4421-b088-1a809f1743e9 req-ca8ce78c-afee-4647-9fbd-d8828d53204f service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received unexpected event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 for instance with vm_state active and task_state rebuild_spawning.
Oct 18 07:23:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-f9f137d7-a9d7-435e-8ebe-6c7630c10489 req-7a4720e3-b44a-4e4a-91c2-8f4f81121a2a service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Received event network-vif-plugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f9f137d7-a9d7-435e-8ebe-6c7630c10489 req-7a4720e3-b44a-4e4a-91c2-8f4f81121a2a service nova] Acquiring lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f9f137d7-a9d7-435e-8ebe-6c7630c10489 req-7a4720e3-b44a-4e4a-91c2-8f4f81121a2a service nova] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f9f137d7-a9d7-435e-8ebe-6c7630c10489 req-7a4720e3-b44a-4e4a-91c2-8f4f81121a2a service nova] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-f9f137d7-a9d7-435e-8ebe-6c7630c10489 req-7a4720e3-b44a-4e4a-91c2-8f4f81121a2a service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] No waiting events found dispatching network-vif-plugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:15 user nova-compute[74587]: WARNING nova.compute.manager [req-f9f137d7-a9d7-435e-8ebe-6c7630c10489 req-7a4720e3-b44a-4e4a-91c2-8f4f81121a2a service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Received unexpected event network-vif-plugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c for instance with vm_state building and task_state spawning.
Oct 18 07:23:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:23:16 user nova-compute[74587]: INFO nova.compute.manager [None req-89136ea9-d877-4291-adc0-4389cb05db6e tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Unrescuing
Oct 18 07:23:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-89136ea9-d877-4291-adc0-4389cb05db6e tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-89136ea9-d877-4291-adc0-4389cb05db6e tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquired lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-89136ea9-d877-4291-adc0-4389cb05db6e tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:23:16 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Instance spawned successfully.
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:23:16 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Instance spawned successfully.
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:23:17 user nova-compute[74587]: INFO nova.compute.manager [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Took 7.29 seconds to spawn the instance on the hypervisor.
Oct 18 07:23:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-e2fc2673-638c-40f7-8397-b0a5237b809b req-2612c5c1-3b7f-4d2d-8b95-dd829bb384d6 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e2fc2673-638c-40f7-8397-b0a5237b809b req-2612c5c1-3b7f-4d2d-8b95-dd829bb384d6 service nova] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e2fc2673-638c-40f7-8397-b0a5237b809b req-2612c5c1-3b7f-4d2d-8b95-dd829bb384d6 service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e2fc2673-638c-40f7-8397-b0a5237b809b req-2612c5c1-3b7f-4d2d-8b95-dd829bb384d6 service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-e2fc2673-638c-40f7-8397-b0a5237b809b req-2612c5c1-3b7f-4d2d-8b95-dd829bb384d6 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] No waiting events found dispatching network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:17 user nova-compute[74587]: WARNING nova.compute.manager [req-e2fc2673-638c-40f7-8397-b0a5237b809b req-2612c5c1-3b7f-4d2d-8b95-dd829bb384d6 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received unexpected event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 for instance with vm_state active and task_state rebuild_spawning.
Oct 18 07:23:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:23:17 user nova-compute[74587]: INFO nova.compute.manager [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Took 8.15 seconds to build instance.
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4b3170bf-8d02-4cdb-a588-1ab99a6e3d08 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.242s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74587) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d679a3e6-7efc-4967-93f3-7985f5405d2f tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-89136ea9-d877-4291-adc0-4389cb05db6e tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Updating instance_info_cache with network_info: [{"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-89136ea9-d877-4291-adc0-4389cb05db6e tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Releasing lock "refresh_cache-f377ac1a-df76-49e1-b727-916d01a7fd02" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-89136ea9-d877-4291-adc0-4389cb05db6e tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'flavor' on Instance uuid f377ac1a-df76-49e1-b727-916d01a7fd02 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-232ff2da-6cae-442f-8058-cb7ec11eaed6 req-a2b9845c-60ca-4a2e-8b94-2939cdcb426f service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-unplugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-232ff2da-6cae-442f-8058-cb7ec11eaed6 req-a2b9845c-60ca-4a2e-8b94-2939cdcb426f service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-232ff2da-6cae-442f-8058-cb7ec11eaed6 req-a2b9845c-60ca-4a2e-8b94-2939cdcb426f service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-232ff2da-6cae-442f-8058-cb7ec11eaed6 req-a2b9845c-60ca-4a2e-8b94-2939cdcb426f service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-232ff2da-6cae-442f-8058-cb7ec11eaed6 req-a2b9845c-60ca-4a2e-8b94-2939cdcb426f service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-unplugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:17 user nova-compute[74587]: WARNING nova.compute.manager [req-232ff2da-6cae-442f-8058-cb7ec11eaed6 req-a2b9845c-60ca-4a2e-8b94-2939cdcb426f service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-unplugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:23:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:18 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Instance destroyed successfully.
Oct 18 07:23:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-73d58e97-7bd9-43fa-89f5-bcbd2566a592 req-02b99ec9-4544-4ee7-a96c-12c203350d60 service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-73d58e97-7bd9-43fa-89f5-bcbd2566a592 req-02b99ec9-4544-4ee7-a96c-12c203350d60 service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-73d58e97-7bd9-43fa-89f5-bcbd2566a592 req-02b99ec9-4544-4ee7-a96c-12c203350d60 service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-73d58e97-7bd9-43fa-89f5-bcbd2566a592 req-02b99ec9-4544-4ee7-a96c-12c203350d60 service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-73d58e97-7bd9-43fa-89f5-bcbd2566a592 req-02b99ec9-4544-4ee7-a96c-12c203350d60 service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:19 user nova-compute[74587]: WARNING nova.compute.manager [req-73d58e97-7bd9-43fa-89f5-bcbd2566a592 req-02b99ec9-4544-4ee7-a96c-12c203350d60 service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:23:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:21 user nova-compute[74587]: WARNING nova.compute.manager [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:23:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:21 user nova-compute[74587]: WARNING nova.compute.manager [req-e1c86b13-31f1-46cd-84c3-d81c166931bb req-68af2d9e-a87f-4bad-8a47-98ac7797a3dc service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state rescued and task_state unrescuing.
Oct 18 07:23:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updating instance_info_cache with network_info: [{"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-89136ea9-d877-4291-adc0-4389cb05db6e tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:23:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:23 user nova-compute[74587]: INFO nova.compute.manager [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Detaching volume e2af70e1-c57e-41fd-85cc-308b0ae14f17
Oct 18 07:23:23 user nova-compute[74587]: INFO nova.virt.block_device [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Attempting to driver detach volume e2af70e1-c57e-41fd-85cc-308b0ae14f17 from mountpoint /dev/vdb
Oct 18 07:23:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Attempting to detach device vdb from instance 57779903-c965-4099-b4fd-d934e02181dd from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:23:23 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:23:23 user nova-compute[74587]:   <source dev="/dev/sdh"/>
Oct 18 07:23:23 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:23:23 user nova-compute[74587]:   <serial>e2af70e1-c57e-41fd-85cc-308b0ae14f17</serial>
Oct 18 07:23:23 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 07:23:23 user nova-compute[74587]: </disk>
Oct 18 07:23:23 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:23 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully detached device vdb from instance 57779903-c965-4099-b4fd-d934e02181dd from the persistent domain config.
Oct 18 07:23:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 57779903-c965-4099-b4fd-d934e02181dd from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:23:23 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:23:23 user nova-compute[74587]:   <source dev="/dev/sdh"/>
Oct 18 07:23:23 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:23:23 user nova-compute[74587]:   <serial>e2af70e1-c57e-41fd-85cc-308b0ae14f17</serial>
Oct 18 07:23:23 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 07:23:23 user nova-compute[74587]: </disk>
Oct 18 07:23:23 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 57779903-c965-4099-b4fd-d934e02181dd {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:23:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:26 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:23:26 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7737MB free_disk=25.045570373535156GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee7e9ad7-fe94-4031-885c-ad134624135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 57779903-c965-4099-b4fd-d934e02181dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance f377ac1a-df76-49e1-b727-916d01a7fd02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a61094a5-cbd8-4dd1-9514-d22cffb95d37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance af696b6e-6fc7-44ee-a514-c49f6f6b340a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 665a2f6d-4704-400e-aeca-ae8cb29333da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:23:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.902s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:29 user nova-compute[74587]: INFO nova.compute.manager [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Terminating instance
Oct 18 07:23:29 user nova-compute[74587]: DEBUG nova.compute.manager [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG nova.compute.manager [req-3eb40c1d-ec7e-4db9-bb38-b9685daabb6d req-e6666151-11b0-4a3d-8f77-4e9d4487b244 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received event network-vif-unplugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3eb40c1d-ec7e-4db9-bb38-b9685daabb6d req-e6666151-11b0-4a3d-8f77-4e9d4487b244 service nova] Acquiring lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3eb40c1d-ec7e-4db9-bb38-b9685daabb6d req-e6666151-11b0-4a3d-8f77-4e9d4487b244 service nova] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3eb40c1d-ec7e-4db9-bb38-b9685daabb6d req-e6666151-11b0-4a3d-8f77-4e9d4487b244 service nova] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG nova.compute.manager [req-3eb40c1d-ec7e-4db9-bb38-b9685daabb6d req-e6666151-11b0-4a3d-8f77-4e9d4487b244 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] No waiting events found dispatching network-vif-unplugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:29 user nova-compute[74587]: DEBUG nova.compute.manager [req-3eb40c1d-ec7e-4db9-bb38-b9685daabb6d req-e6666151-11b0-4a3d-8f77-4e9d4487b244 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received event network-vif-unplugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:23:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Instance destroyed successfully.
Oct 18 07:23:30 user nova-compute[74587]: DEBUG nova.objects.instance [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'resources' on Instance uuid b1c2c7fb-7f42-49df-9d7b-706dffa5a6db {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-180971638',display_name='tempest-AttachVolumeNegativeTest-server-180971638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-180971638',id=20,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkVxS9OBxn1DlPHxFEpD3VFGmdSz17qhlp/r9JxNnYfQ0YYvloKFPyDvAuSKU6SH+RP2EA8odbdr9Dgh9V10WCkYTfVBVKnohiDdaFDs5uJWcs9SRTY4Yhe7LsnXg9fdA==',key_name='tempest-keypair-559186231',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-vzy56vtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:17:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=b1c2c7fb-7f42-49df-9d7b-706dffa5a6db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "address": "fa:16:3e:81:1c:3e", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5943d9a8-1b", "ovs_interfaceid": "5943d9a8-1bde-4fec-809b-c2887cf98dc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:1c:3e,bridge_name='br-int',has_traffic_filtering=True,id=5943d9a8-1bde-4fec-809b-c2887cf98dc6,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5943d9a8-1b') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG os_vif [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:1c:3e,bridge_name='br-int',has_traffic_filtering=True,id=5943d9a8-1bde-4fec-809b-c2887cf98dc6,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5943d9a8-1b') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5943d9a8-1b, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1671e895-2636-4e5b-9c04-6c29da97528e) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:30 user nova-compute[74587]: INFO os_vif [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:1c:3e,bridge_name='br-int',has_traffic_filtering=True,id=5943d9a8-1bde-4fec-809b-c2887cf98dc6,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5943d9a8-1b')
Oct 18 07:23:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Deleting instance files /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db_del
Oct 18 07:23:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Deletion of /opt/stack/data/nova/instances/b1c2c7fb-7f42-49df-9d7b-706dffa5a6db_del complete
Oct 18 07:23:30 user nova-compute[74587]: INFO nova.compute.manager [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 18 07:23:30 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:23:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:23:31 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Took 0.69 seconds to deallocate network for instance.
Oct 18 07:23:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-19b00590-bffd-4be9-bae8-0427d6023060 req-31085936-03e6-4a56-9d0e-734e1a486fb8 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received event network-vif-deleted-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:31 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Deleted allocations for instance b1c2c7fb-7f42-49df-9d7b-706dffa5a6db
Oct 18 07:23:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-bf5247b8-9ab8-4fa8-b82e-bbc26d2e3f5f tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.177s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-e3e7abba-2fd5-4d6d-bc2a-e7e33c3fa1f2 req-c183cf02-f969-4cb5-8c3e-c0808898f308 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received event network-vif-plugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e3e7abba-2fd5-4d6d-bc2a-e7e33c3fa1f2 req-c183cf02-f969-4cb5-8c3e-c0808898f308 service nova] Acquiring lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e3e7abba-2fd5-4d6d-bc2a-e7e33c3fa1f2 req-c183cf02-f969-4cb5-8c3e-c0808898f308 service nova] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e3e7abba-2fd5-4d6d-bc2a-e7e33c3fa1f2 req-c183cf02-f969-4cb5-8c3e-c0808898f308 service nova] Lock "b1c2c7fb-7f42-49df-9d7b-706dffa5a6db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-e3e7abba-2fd5-4d6d-bc2a-e7e33c3fa1f2 req-c183cf02-f969-4cb5-8c3e-c0808898f308 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] No waiting events found dispatching network-vif-plugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:31 user nova-compute[74587]: WARNING nova.compute.manager [req-e3e7abba-2fd5-4d6d-bc2a-e7e33c3fa1f2 req-c183cf02-f969-4cb5-8c3e-c0808898f308 service nova] [instance: b1c2c7fb-7f42-49df-9d7b-706dffa5a6db] Received unexpected event network-vif-plugged-5943d9a8-1bde-4fec-809b-c2887cf98dc6 for instance with vm_state deleted and task_state None.
Oct 18 07:23:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:43 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 57779903-c965-4099-b4fd-d934e02181dd is timed out.
Oct 18 07:23:43 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully detached device vdb from instance 57779903-c965-4099-b4fd-d934e02181dd from the live domain config.
Oct 18 07:23:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEKFqhnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:23:43 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7981518a-5dbf-44da-988e-7f211d44c6fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:23:43 user nova-compute[74587]: No targets found.
Oct 18 07:23:43 user nova-compute[74587]: iSNS:
Oct 18 07:23:43 user nova-compute[74587]: No targets found.
Oct 18 07:23:43 user nova-compute[74587]: STATIC:
Oct 18 07:23:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17
Oct 18 07:23:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:23:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:23:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:23:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:23:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:23:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da
Oct 18 07:23:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:23:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:23:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:23:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:23:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:23:43 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a
Oct 18 07:23:43 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:23:43 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:23:43 user nova-compute[74587]: FIRMWARE:
Oct 18 07:23:43 user nova-compute[74587]: No targets found.
Oct 18 07:23:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:23:43 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:23:43 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a630f394-a4f4-411c-9444-b1265227b00d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e6360d-36bb-45b0-9856-ff845a920a46]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:23:43 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:23:43 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:23:43 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:23:43 user nova-compute[74587]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:23:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:23:43 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:23:43 user nova-compute[74587]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 (non-flash)
Oct 18 07:23:43 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:23:43 user nova-compute[74587]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:23:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1008230310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17'): ({'sdh'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Removing single pathed devices sdh {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a9c29e-f505-4814-b358-5ff9bc914ee4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[772acf51-f207-4873-ad2a-2eebdea866c2]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flushing IO for device /dev/sdh {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d655c6-1570-4836-8cc4-d087b6deb3be]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d3f76d-48e5-4046-aad4-166439997133]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] SCSI volumes sdh have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:23:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[60056017-373d-4760-8cf3-8624a836d8f4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be6f893-f88c-4757-8fb9-e2431094f6f2]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260]
Oct 18 07:23:44 user nova-compute[74587]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17, portal: 172.16.0.220,3260] successful.
Oct 18 07:23:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2af70e1-c57e-41fd-85cc-308b0ae14f17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e94c934-f09e-4f38-bdc1-2ba5ef5c5551]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== disconnect_volume: return (356ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 12b4c420-79fd-4f58-a422-59dc2b89731f {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 773850ee-146d-4e76-9096-8dc18e03221f {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid ee7e9ad7-fe94-4031-885c-ad134624135f {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid f377ac1a-df76-49e1-b727-916d01a7fd02 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid af696b6e-6fc7-44ee-a514-c49f6f6b340a {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 665a2f6d-4704-400e-aeca-ae8cb29333da {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 57779903-c965-4099-b4fd-d934e02181dd {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid a61094a5-cbd8-4dd1-9514-d22cffb95d37 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "773850ee-146d-4e76-9096-8dc18e03221f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "773850ee-146d-4e76-9096-8dc18e03221f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "ee7e9ad7-fe94-4031-885c-ad134624135f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "665a2f6d-4704-400e-aeca-ae8cb29333da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "773850ee-146d-4e76-9096-8dc18e03221f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:44 user nova-compute[74587]: DEBUG nova.objects.instance [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'flavor' on Instance uuid 57779903-c965-4099-b4fd-d934e02181dd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:23:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-93c02d05-554d-4dd6-8da2-0fe6ebae2190 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "57779903-c965-4099-b4fd-d934e02181dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.344s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "57779903-c965-4099-b4fd-d934e02181dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:54 user nova-compute[74587]: INFO nova.compute.manager [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Terminating instance
Oct 18 07:23:54 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:23:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG nova.compute.manager [req-900a1cde-a2d5-4e58-84b1-1558d72fb890 req-39842a4c-c3ab-444d-893b-91637dc03be8 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-vif-unplugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-900a1cde-a2d5-4e58-84b1-1558d72fb890 req-39842a4c-c3ab-444d-893b-91637dc03be8 service nova] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-900a1cde-a2d5-4e58-84b1-1558d72fb890 req-39842a4c-c3ab-444d-893b-91637dc03be8 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-900a1cde-a2d5-4e58-84b1-1558d72fb890 req-39842a4c-c3ab-444d-893b-91637dc03be8 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG nova.compute.manager [req-900a1cde-a2d5-4e58-84b1-1558d72fb890 req-39842a4c-c3ab-444d-893b-91637dc03be8 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] No waiting events found dispatching network-vif-unplugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG nova.compute.manager [req-900a1cde-a2d5-4e58-84b1-1558d72fb890 req-39842a4c-c3ab-444d-893b-91637dc03be8 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-vif-unplugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:55 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Instance destroyed successfully.
Oct 18 07:23:55 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'resources' on Instance uuid d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1979991676',display_name='tempest-ServerRescueNegativeTestJSON-server-1979991676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1979991676',id=2,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:09:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-aumf0bef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:09:06Z,user_data=None,user_id='96efd41052434514aea7fe47a5eb36f7',uuid=d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "address": "fa:16:3e:f6:c0:14", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f50ec-04", "ovs_interfaceid": "da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c0:14,bridge_name='br-int',has_traffic_filtering=True,id=da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f50ec-04') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG os_vif [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c0:14,bridge_name='br-int',has_traffic_filtering=True,id=da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f50ec-04') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda3f50ec-04, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af1ba5ec-b9f4-43f9-a278-b38433d92f0a) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:55 user nova-compute[74587]: INFO os_vif [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c0:14,bridge_name='br-int',has_traffic_filtering=True,id=da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f50ec-04')
Oct 18 07:23:55 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Deleting instance files /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7_del
Oct 18 07:23:55 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Deletion of /opt/stack/data/nova/instances/d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7_del complete
Oct 18 07:23:55 user nova-compute[74587]: INFO nova.compute.manager [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 18 07:23:55 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:23:55 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:23:56 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:23:56 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Took 0.44 seconds to deallocate network for instance.
Oct 18 07:23:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-e7875073-ac03-4086-a980-459c43d387cc req-1086804a-5a59-4497-94e7-6f2124fbd9c3 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-vif-deleted-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:56 user nova-compute[74587]: INFO nova.compute.manager [req-e7875073-ac03-4086-a980-459c43d387cc req-1086804a-5a59-4497-94e7-6f2124fbd9c3 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Neutron deleted interface da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0; detaching it from the instance and deleting it from the info cache
Oct 18 07:23:56 user nova-compute[74587]: DEBUG nova.network.neutron [req-e7875073-ac03-4086-a980-459c43d387cc req-1086804a-5a59-4497-94e7-6f2124fbd9c3 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:23:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-e7875073-ac03-4086-a980-459c43d387cc req-1086804a-5a59-4497-94e7-6f2124fbd9c3 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Detach interface failed, port_id=da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0, reason: Instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7 could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:23:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:56 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:23:56 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:23:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:56 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Deleted allocations for instance d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7
Oct 18 07:23:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3698fbcb-defb-4b6b-a9d3-1efab2d52a4f tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.854s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:23:57 user nova-compute[74587]: DEBUG nova.compute.manager [req-62a1132d-ea77-4849-90bf-ed5201fabb4d req-32848852-4f6d-47a5-97bd-5cfe64364d69 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:23:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-62a1132d-ea77-4849-90bf-ed5201fabb4d req-32848852-4f6d-47a5-97bd-5cfe64364d69 service nova] Acquiring lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:23:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-62a1132d-ea77-4849-90bf-ed5201fabb4d req-32848852-4f6d-47a5-97bd-5cfe64364d69 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:23:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-62a1132d-ea77-4849-90bf-ed5201fabb4d req-32848852-4f6d-47a5-97bd-5cfe64364d69 service nova] Lock "d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:23:57 user nova-compute[74587]: DEBUG nova.compute.manager [req-62a1132d-ea77-4849-90bf-ed5201fabb4d req-32848852-4f6d-47a5-97bd-5cfe64364d69 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] No waiting events found dispatching network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:23:57 user nova-compute[74587]: WARNING nova.compute.manager [req-62a1132d-ea77-4849-90bf-ed5201fabb4d req-32848852-4f6d-47a5-97bd-5cfe64364d69 service nova] [instance: d11f6e5a-ceb6-4aa4-827f-1b8a3d204fc7] Received unexpected event network-vif-plugged-da3f50ec-04fa-49c5-a7c9-30a66e8c5bc0 for instance with vm_state deleted and task_state None.
Oct 18 07:24:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-4380d8df-ed6b-4839-a182-c912fb16de3a req-4dc573f7-e445-48d5-b090-0d3a51d68103 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received event network-changed-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-4380d8df-ed6b-4839-a182-c912fb16de3a req-4dc573f7-e445-48d5-b090-0d3a51d68103 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Refreshing instance network info cache due to event network-changed-84e29791-fdbb-48a2-962e-514b20c0dbe9. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:24:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4380d8df-ed6b-4839-a182-c912fb16de3a req-4dc573f7-e445-48d5-b090-0d3a51d68103 service nova] Acquiring lock "refresh_cache-af696b6e-6fc7-44ee-a514-c49f6f6b340a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:24:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4380d8df-ed6b-4839-a182-c912fb16de3a req-4dc573f7-e445-48d5-b090-0d3a51d68103 service nova] Acquired lock "refresh_cache-af696b6e-6fc7-44ee-a514-c49f6f6b340a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:24:05 user nova-compute[74587]: DEBUG nova.network.neutron [req-4380d8df-ed6b-4839-a182-c912fb16de3a req-4dc573f7-e445-48d5-b090-0d3a51d68103 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Refreshing network info cache for port 84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:24:06 user nova-compute[74587]: DEBUG nova.network.neutron [req-4380d8df-ed6b-4839-a182-c912fb16de3a req-4dc573f7-e445-48d5-b090-0d3a51d68103 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Updated VIF entry in instance network info cache for port 84e29791-fdbb-48a2-962e-514b20c0dbe9. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:24:06 user nova-compute[74587]: DEBUG nova.network.neutron [req-4380d8df-ed6b-4839-a182-c912fb16de3a req-4dc573f7-e445-48d5-b090-0d3a51d68103 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Updating instance_info_cache with network_info: [{"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4380d8df-ed6b-4839-a182-c912fb16de3a req-4dc573f7-e445-48d5-b090-0d3a51d68103 service nova] Releasing lock "refresh_cache-af696b6e-6fc7-44ee-a514-c49f6f6b340a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:24:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:12 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:24:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:13 user nova-compute[74587]: INFO nova.compute.manager [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Terminating instance
Oct 18 07:24:13 user nova-compute[74587]: DEBUG nova.compute.manager [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-351d3760-3f55-4d64-8ff9-409081e0b87e req-6259e9d9-5148-4699-a705-b554d3f58deb service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-vif-unplugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-351d3760-3f55-4d64-8ff9-409081e0b87e req-6259e9d9-5148-4699-a705-b554d3f58deb service nova] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-351d3760-3f55-4d64-8ff9-409081e0b87e req-6259e9d9-5148-4699-a705-b554d3f58deb service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-351d3760-3f55-4d64-8ff9-409081e0b87e req-6259e9d9-5148-4699-a705-b554d3f58deb service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-351d3760-3f55-4d64-8ff9-409081e0b87e req-6259e9d9-5148-4699-a705-b554d3f58deb service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] No waiting events found dispatching network-vif-unplugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-351d3760-3f55-4d64-8ff9-409081e0b87e req-6259e9d9-5148-4699-a705-b554d3f58deb service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-vif-unplugged-deba39b8-e178-4b6a-bf64-6b36d2980719 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Instance destroyed successfully.
Oct 18 07:24:14 user nova-compute[74587]: DEBUG nova.objects.instance [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'resources' on Instance uuid 57779903-c965-4099-b4fd-d934e02181dd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-131303816',display_name='tempest-ServerActionsTestOtherA-server-148190764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-131303816',id=21,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtvGfBTkmICl93Y629GSp9vxRmRb7ktS6MkPEYxnd5r5dWprV6nU6Bni5nfUEjdsOZs2O5IEA4YwJeshclRhNFjFWY1pmae36/MF/uwYENjseuyRf+tfHlT2QHevzVfsg==',key_name='tempest-keypair-1663639896',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-1mfq5t8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=57779903-c965-4099-b4fd-d934e02181dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "deba39b8-e178-4b6a-bf64-6b36d2980719", "address": "fa:16:3e:e4:25:0d", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeba39b8-e1", "ovs_interfaceid": "deba39b8-e178-4b6a-bf64-6b36d2980719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG os_vif [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeba39b8-e1, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11787b04-6fee-47c1-8893-fa2cf2055eb8) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:14 user nova-compute[74587]: INFO os_vif [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=deba39b8-e178-4b6a-bf64-6b36d2980719,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeba39b8-e1')
Oct 18 07:24:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Deleting instance files /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd_del
Oct 18 07:24:14 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Deletion of /opt/stack/data/nova/instances/57779903-c965-4099-b4fd-d934e02181dd_del complete
Oct 18 07:24:14 user nova-compute[74587]: INFO nova.compute.manager [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 18 07:24:14 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:24:14 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 57779903-c965-4099-b4fd-d934e02181dd] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:15 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Took 0.67 seconds to deallocate network for instance.
Oct 18 07:24:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-ce8dab05-2305-4b58-835e-0d032c66168d req-613cfe19-b0a3-42f3-b900-2e5335b9a5ba service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-vif-deleted-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:15 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Deleted allocations for instance 57779903-c965-4099-b4fd-d934e02181dd
Oct 18 07:24:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-b8b063e7-6855-49b6-aa1c-d30dabe2f2e2 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "57779903-c965-4099-b4fd-d934e02181dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.141s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-7556fe7a-4de0-4359-8627-53e9bb3e9764 req-ff679657-f3d8-42f5-ba86-10c526fc115a service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7556fe7a-4de0-4359-8627-53e9bb3e9764 req-ff679657-f3d8-42f5-ba86-10c526fc115a service nova] Acquiring lock "57779903-c965-4099-b4fd-d934e02181dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7556fe7a-4de0-4359-8627-53e9bb3e9764 req-ff679657-f3d8-42f5-ba86-10c526fc115a service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7556fe7a-4de0-4359-8627-53e9bb3e9764 req-ff679657-f3d8-42f5-ba86-10c526fc115a service nova] Lock "57779903-c965-4099-b4fd-d934e02181dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-7556fe7a-4de0-4359-8627-53e9bb3e9764 req-ff679657-f3d8-42f5-ba86-10c526fc115a service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] No waiting events found dispatching network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:15 user nova-compute[74587]: WARNING nova.compute.manager [req-7556fe7a-4de0-4359-8627-53e9bb3e9764 req-ff679657-f3d8-42f5-ba86-10c526fc115a service nova] [instance: 57779903-c965-4099-b4fd-d934e02181dd] Received unexpected event network-vif-plugged-deba39b8-e178-4b6a-bf64-6b36d2980719 for instance with vm_state deleted and task_state None.
Oct 18 07:24:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:24:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:24:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:18 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:24:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:18 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:24:18 user nova-compute[74587]: INFO nova.compute.claims [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Claim successful on node user
Oct 18 07:24:19 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:24:19 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:24:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:19 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:24:19 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:24:19 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:24:19 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:24:19 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:24:19 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:24:19 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:24:19 user nova-compute[74587]: INFO nova.virt.block_device [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Booting with volume snapshot fbba2d9a-798c-42d4-ae3e-f032f8bd50d1 at /dev/vda
Oct 18 07:24:19 user nova-compute[74587]: DEBUG nova.policy [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd13de789e98e4ba9ad22d665ff8e4ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cfa00773ba4c5498c56b84ccb307a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:24:20 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Successfully created port: 83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:24:20 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Successfully updated port: 83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:24:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "refresh_cache-92ab75dd-21c4-4067-9e9a-6a86861bcfea" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:24:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquired lock "refresh_cache-92ab75dd-21c4-4067-9e9a-6a86861bcfea" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:24:20 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:24:20 user nova-compute[74587]: DEBUG nova.compute.manager [req-c7bc2bd4-f6b6-4009-89e0-668ccaf822c7 req-0020def8-65e6-4f9c-b19d-23deac1d0c20 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received event network-changed-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:20 user nova-compute[74587]: DEBUG nova.compute.manager [req-c7bc2bd4-f6b6-4009-89e0-668ccaf822c7 req-0020def8-65e6-4f9c-b19d-23deac1d0c20 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Refreshing instance network info cache due to event network-changed-83696a27-5180-489d-979c-adf769267f90. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:24:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c7bc2bd4-f6b6-4009-89e0-668ccaf822c7 req-0020def8-65e6-4f9c-b19d-23deac1d0c20 service nova] Acquiring lock "refresh_cache-92ab75dd-21c4-4067-9e9a-6a86861bcfea" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:24:20 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Updating instance_info_cache with network_info: [{"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Releasing lock "refresh_cache-92ab75dd-21c4-4067-9e9a-6a86861bcfea" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Instance network_info: |[{"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c7bc2bd4-f6b6-4009-89e0-668ccaf822c7 req-0020def8-65e6-4f9c-b19d-23deac1d0c20 service nova] Acquired lock "refresh_cache-92ab75dd-21c4-4067-9e9a-6a86861bcfea" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG nova.network.neutron [req-c7bc2bd4-f6b6-4009-89e0-668ccaf822c7 req-0020def8-65e6-4f9c-b19d-23deac1d0c20 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Refreshing network info cache for port 83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG nova.network.neutron [req-c7bc2bd4-f6b6-4009-89e0-668ccaf822c7 req-0020def8-65e6-4f9c-b19d-23deac1d0c20 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Updated VIF entry in instance network info cache for port 83696a27-5180-489d-979c-adf769267f90. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG nova.network.neutron [req-c7bc2bd4-f6b6-4009-89e0-668ccaf822c7 req-0020def8-65e6-4f9c-b19d-23deac1d0c20 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Updating instance_info_cache with network_info: [{"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c7bc2bd4-f6b6-4009-89e0-668ccaf822c7 req-0020def8-65e6-4f9c-b19d-23deac1d0c20 service nova] Releasing lock "refresh_cache-92ab75dd-21c4-4067-9e9a-6a86861bcfea" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:24:23 user nova-compute[74587]: INFO nova.compute.claims [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Claim successful on node user
Oct 18 07:24:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:23 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:24:23 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:24:23 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7617MB free_disk=25.100677490234375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:24:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.793s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.257s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:24:24 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0d568195-c89b-47e8-9992-bfc3a6c8e929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee7e9ad7-fe94-4031-885c-ad134624135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance f377ac1a-df76-49e1-b727-916d01a7fd02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a61094a5-cbd8-4dd1-9514-d22cffb95d37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance af696b6e-6fc7-44ee-a514-c49f6f6b340a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 665a2f6d-4704-400e-aeca-ae8cb29333da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 92ab75dd-21c4-4067-9e9a-6a86861bcfea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.policy [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aceede4662a4aaa92c79dfd538effea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc0eafb55fd4673a3d8fcb0e63602c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:24:24 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Creating image(s)
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "/opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "/opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.196s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk 1073741824" returned: 0 in 0.056s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Successfully created port: d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG os_brick.utils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Cannot resize image /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Ensure instance console log exists: /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[98730c7e-1a3c-45e2-b071-6e25cfdb2187]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f431406-cc3c-4333-a5fd-6f8e4c59dfb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f313293c-c53b-4e4d-89d2-ff729837ff26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[959cd3ea-3dd6-421d-bc31-7d43881e0c94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:24:25 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bae8a50-19a4-4555-94bc-23794a82d419]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG os_brick.utils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Updating existing volume attachment record: 05f4f36e-4f6b-4998-bebd-f03dfee32477 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-ee7e9ad7-fe94-4031-885c-ad134624135f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-ee7e9ad7-fe94-4031-885c-ad134624135f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Successfully updated port: d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "refresh_cache-d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquired lock "refresh_cache-d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-e3c41f47-1af5-4a57-8e6e-f7cdc2dfb273 req-7978bbbb-d499-46cc-aa10-5b81dbf42415 service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received event network-changed-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-e3c41f47-1af5-4a57-8e6e-f7cdc2dfb273 req-7978bbbb-d499-46cc-aa10-5b81dbf42415 service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Refreshing instance network info cache due to event network-changed-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e3c41f47-1af5-4a57-8e6e-f7cdc2dfb273 req-7978bbbb-d499-46cc-aa10-5b81dbf42415 service nova] Acquiring lock "refresh_cache-d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:24:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:26 user nova-compute[74587]: INFO nova.compute.manager [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Unshelving
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Updating instance_info_cache with network_info: [{"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Releasing lock "refresh_cache-d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Instance network_info: |[{"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Updating instance_info_cache with network_info: [{"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e3c41f47-1af5-4a57-8e6e-f7cdc2dfb273 req-7978bbbb-d499-46cc-aa10-5b81dbf42415 service nova] Acquired lock "refresh_cache-d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-e3c41f47-1af5-4a57-8e6e-f7cdc2dfb273 req-7978bbbb-d499-46cc-aa10-5b81dbf42415 service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Refreshing network info cache for port d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Start _get_guest_xml network_info=[{"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'pci_requests' on Instance uuid db21a40f-ceef-4c74-949f-80b83c82f1e5 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-ee7e9ad7-fe94-4031-885c-ad134624135f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'numa_topology' on Instance uuid db21a40f-ceef-4c74-949f-80b83c82f1e5 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:26 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:24:26 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:24:26 user nova-compute[74587]: INFO nova.compute.claims [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Claim successful on node user
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-362773906',display_name='tempest-AttachVolumeNegativeTest-server-362773906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-362773906',id=30,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsEZiuI3N82+Yz3r26vJMJ+5ZiaiqyeqrGbvTNdtYgzMBNvh/AR6nSoWJwkbnxuBUijtLT6Fh2z+4k8j3X9EqiUWmlQ/S/lmTZULkbtrADyvhHnSUD5oin0kKs7xziTiw==',key_name='tempest-keypair-77818563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-sxuuz7eu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:f0,bridge_name='br-int',has_traffic_filtering=True,id=d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5284438-c3') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.objects.instance [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'pci_devices' on Instance uuid d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:24:26 user nova-compute[74587]:   <uuid>d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db</uuid>
Oct 18 07:24:26 user nova-compute[74587]:   <name>instance-0000001e</name>
Oct 18 07:24:26 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:24:26 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:24:26 user nova-compute[74587]:   <metadata>
Oct 18 07:24:26 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:24:26 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:24:26 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeNegativeTest-server-362773906</nova:name>
Oct 18 07:24:26 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:24:26</nova:creationTime>
Oct 18 07:24:26 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:24:26 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:24:26 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:24:26 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:24:26 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:24:26 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:24:26 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:24:26 user nova-compute[74587]:       <nova:owner>
Oct 18 07:24:26 user nova-compute[74587]:         <nova:user uuid="8aceede4662a4aaa92c79dfd538effea">tempest-AttachVolumeNegativeTest-859195449-project-member</nova:user>
Oct 18 07:24:26 user nova-compute[74587]:         <nova:project uuid="0cc0eafb55fd4673a3d8fcb0e63602c7">tempest-AttachVolumeNegativeTest-859195449</nova:project>
Oct 18 07:24:26 user nova-compute[74587]:       </nova:owner>
Oct 18 07:24:26 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:24:26 user nova-compute[74587]:       <nova:ports>
Oct 18 07:24:26 user nova-compute[74587]:         <nova:port uuid="d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2">
Oct 18 07:24:26 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 18 07:24:26 user nova-compute[74587]:         </nova:port>
Oct 18 07:24:26 user nova-compute[74587]:       </nova:ports>
Oct 18 07:24:26 user nova-compute[74587]:     </nova:instance>
Oct 18 07:24:26 user nova-compute[74587]:   </metadata>
Oct 18 07:24:26 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:24:26 user nova-compute[74587]:     <system>
Oct 18 07:24:26 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:24:26 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:24:26 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:24:26 user nova-compute[74587]:       <entry name="serial">d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db</entry>
Oct 18 07:24:26 user nova-compute[74587]:       <entry name="uuid">d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db</entry>
Oct 18 07:24:26 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:24:26 user nova-compute[74587]:     </system>
Oct 18 07:24:26 user nova-compute[74587]:   </sysinfo>
Oct 18 07:24:26 user nova-compute[74587]:   <os>
Oct 18 07:24:26 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:24:26 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:24:26 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:24:26 user nova-compute[74587]:   </os>
Oct 18 07:24:26 user nova-compute[74587]:   <features>
Oct 18 07:24:26 user nova-compute[74587]:     <acpi/>
Oct 18 07:24:26 user nova-compute[74587]:     <apic/>
Oct 18 07:24:26 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:24:26 user nova-compute[74587]:   </features>
Oct 18 07:24:26 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:24:26 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:24:26 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:24:26 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:24:26 user nova-compute[74587]:   </clock>
Oct 18 07:24:26 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:24:26 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:24:26 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:24:26 user nova-compute[74587]:   </cpu>
Oct 18 07:24:26 user nova-compute[74587]:   <devices>
Oct 18 07:24:26 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:24:26 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:24:26 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk"/>
Oct 18 07:24:26 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:24:26 user nova-compute[74587]:     </disk>
Oct 18 07:24:26 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:24:26 user nova-compute[74587]:       <mac address="fa:16:3e:ad:29:f0"/>
Oct 18 07:24:26 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:24:26 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:24:26 user nova-compute[74587]:       <target dev="tapd5284438-c3"/>
Oct 18 07:24:26 user nova-compute[74587]:     </interface>
Oct 18 07:24:26 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:24:26 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/console.log" append="off"/>
Oct 18 07:24:26 user nova-compute[74587]:     </serial>
Oct 18 07:24:26 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:24:26 user nova-compute[74587]:     <video>
Oct 18 07:24:26 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:24:26 user nova-compute[74587]:     </video>
Oct 18 07:24:26 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:24:26 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:24:26 user nova-compute[74587]:     </rng>
Oct 18 07:24:26 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:24:26 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:24:26 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:24:26 user nova-compute[74587]:     </memballoon>
Oct 18 07:24:26 user nova-compute[74587]:   </devices>
Oct 18 07:24:26 user nova-compute[74587]: </domain>
Oct 18 07:24:26 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-362773906',display_name='tempest-AttachVolumeNegativeTest-server-362773906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-362773906',id=30,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsEZiuI3N82+Yz3r26vJMJ+5ZiaiqyeqrGbvTNdtYgzMBNvh/AR6nSoWJwkbnxuBUijtLT6Fh2z+4k8j3X9EqiUWmlQ/S/lmTZULkbtrADyvhHnSUD5oin0kKs7xziTiw==',key_name='tempest-keypair-77818563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-sxuuz7eu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:f0,bridge_name='br-int',has_traffic_filtering=True,id=d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5284438-c3') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG os_vif [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:f0,bridge_name='br-int',has_traffic_filtering=True,id=d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5284438-c3') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9567da1-95de-5792-b58d-bf9945234dbf', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5284438-c3, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5284438-c3, col_values=(('qos', UUID('f69437ed-18c0-4763-9827-86a701d518cb')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5284438-c3, col_values=(('external_ids', {'iface-id': 'd5284438-c32e-4b3b-8c8f-f2fcf3cbbca2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:29:f0', 'vm-uuid': 'd3dafc90-7f5f-4b90-99b1-5cfc9fbc05db'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:26 user nova-compute[74587]: INFO os_vif [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:f0,bridge_name='br-int',has_traffic_filtering=True,id=d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5284438-c3')
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No VIF found with MAC fa:16:3e:ad:29:f0, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-e3c41f47-1af5-4a57-8e6e-f7cdc2dfb273 req-7978bbbb-d499-46cc-aa10-5b81dbf42415 service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Updated VIF entry in instance network info cache for port d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-e3c41f47-1af5-4a57-8e6e-f7cdc2dfb273 req-7978bbbb-d499-46cc-aa10-5b81dbf42415 service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Updating instance_info_cache with network_info: [{"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e3c41f47-1af5-4a57-8e6e-f7cdc2dfb273 req-7978bbbb-d499-46cc-aa10-5b81dbf42415 service nova] Releasing lock "refresh_cache-d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:26 user nova-compute[74587]: INFO nova.network.neutron [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updating port 6b0a10ff-6fe0-4564-b1ea-29cc81f01924 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 18 07:24:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquired lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG nova.network.neutron [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-24c8a07b-83fc-4bdb-81ea-4a4fc37b4d33 req-bc742d87-1e22-4718-8063-6bad5ca3d54a service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-changed-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-24c8a07b-83fc-4bdb-81ea-4a4fc37b4d33 req-bc742d87-1e22-4718-8063-6bad5ca3d54a service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Refreshing instance network info cache due to event network-changed-6b0a10ff-6fe0-4564-b1ea-29cc81f01924. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-24c8a07b-83fc-4bdb-81ea-4a4fc37b4d33 req-bc742d87-1e22-4718-8063-6bad5ca3d54a service nova] Acquiring lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG nova.network.neutron [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updating instance_info_cache with network_info: [{"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Releasing lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:24:27 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Creating image(s)
Oct 18 07:24:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "/opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "/opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "/opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'trusted_certs' on Instance uuid db21a40f-ceef-4c74-949f-80b83c82f1e5 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-24c8a07b-83fc-4bdb-81ea-4a4fc37b4d33 req-bc742d87-1e22-4718-8063-6bad5ca3d54a service nova] Acquired lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG nova.network.neutron [req-24c8a07b-83fc-4bdb-81ea-4a4fc37b4d33 req-bc742d87-1e22-4718-8063-6bad5ca3d54a service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Refreshing network info cache for port 6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG nova.objects.base [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Object Instance<db21a40f-ceef-4c74-949f-80b83c82f1e5> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "27a4a8d8b802534c1a4f7ca96efcf90187d96d7a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "27a4a8d8b802534c1a4f7ca96efcf90187d96d7a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a.part --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-8aa6a2b7-1dd3-44f7-928f-ff50cf767632 req-0b1e2d41-4b04-4a5e-9013-65a7095c3adf service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received event network-vif-plugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8aa6a2b7-1dd3-44f7-928f-ff50cf767632 req-0b1e2d41-4b04-4a5e-9013-65a7095c3adf service nova] Acquiring lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8aa6a2b7-1dd3-44f7-928f-ff50cf767632 req-0b1e2d41-4b04-4a5e-9013-65a7095c3adf service nova] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8aa6a2b7-1dd3-44f7-928f-ff50cf767632 req-0b1e2d41-4b04-4a5e-9013-65a7095c3adf service nova] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-8aa6a2b7-1dd3-44f7-928f-ff50cf767632 req-0b1e2d41-4b04-4a5e-9013-65a7095c3adf service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] No waiting events found dispatching network-vif-plugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:28 user nova-compute[74587]: WARNING nova.compute.manager [req-8aa6a2b7-1dd3-44f7-928f-ff50cf767632 req-0b1e2d41-4b04-4a5e-9013-65a7095c3adf service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received unexpected event network-vif-plugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 for instance with vm_state building and task_state spawning.
Oct 18 07:24:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:28 user nova-compute[74587]: DEBUG nova.virt.images [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] 347a56e0-4d2c-411b-9695-23356f80f1ed was qcow2, converting to raw {{(pid=74587) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 07:24:28 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:24:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a.part /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a.converted {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:29 user nova-compute[74587]: DEBUG nova.network.neutron [req-24c8a07b-83fc-4bdb-81ea-4a4fc37b4d33 req-bc742d87-1e22-4718-8063-6bad5ca3d54a service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updated VIF entry in instance network info cache for port 6b0a10ff-6fe0-4564-b1ea-29cc81f01924. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:24:29 user nova-compute[74587]: DEBUG nova.network.neutron [req-24c8a07b-83fc-4bdb-81ea-4a4fc37b4d33 req-bc742d87-1e22-4718-8063-6bad5ca3d54a service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updating instance_info_cache with network_info: [{"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-24c8a07b-83fc-4bdb-81ea-4a4fc37b4d33 req-bc742d87-1e22-4718-8063-6bad5ca3d54a service nova] Releasing lock "refresh_cache-db21a40f-ceef-4c74-949f-80b83c82f1e5" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:24:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a.part /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a.converted" returned: 0 in 0.633s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a.converted --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a.converted --force-share --output=json" returned: 0 in 0.247s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "27a4a8d8b802534c1a4f7ca96efcf90187d96d7a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.111s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-0f2908f6-4afd-4331-ac75-f387f498bd82 req-0c0a95fd-82a5-4d26-887d-344ee6d906cd service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received event network-vif-plugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0f2908f6-4afd-4331-ac75-f387f498bd82 req-0c0a95fd-82a5-4d26-887d-344ee6d906cd service nova] Acquiring lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0f2908f6-4afd-4331-ac75-f387f498bd82 req-0c0a95fd-82a5-4d26-887d-344ee6d906cd service nova] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0f2908f6-4afd-4331-ac75-f387f498bd82 req-0c0a95fd-82a5-4d26-887d-344ee6d906cd service nova] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-0f2908f6-4afd-4331-ac75-f387f498bd82 req-0c0a95fd-82a5-4d26-887d-344ee6d906cd service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] No waiting events found dispatching network-vif-plugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:30 user nova-compute[74587]: WARNING nova.compute.manager [req-0f2908f6-4afd-4331-ac75-f387f498bd82 req-0c0a95fd-82a5-4d26-887d-344ee6d906cd service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received unexpected event network-vif-plugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 for instance with vm_state building and task_state spawning.
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a --force-share --output=json" returned: 0 in 0.205s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "27a4a8d8b802534c1a4f7ca96efcf90187d96d7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "27a4a8d8b802534c1a4f7ca96efcf90187d96d7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a --force-share --output=json" returned: 0 in 0.169s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a,backing_fmt=raw /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a,backing_fmt=raw /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk 1073741824" returned: 0 in 0.050s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "27a4a8d8b802534c1a4f7ca96efcf90187d96d7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:24:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Instance spawned successfully.
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'migration_context' on Instance uuid db21a40f-ceef-4c74-949f-80b83c82f1e5 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:30 user nova-compute[74587]: INFO nova.compute.manager [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Took 6.12 seconds to spawn the instance on the hypervisor.
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG nova.objects.base [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Object Instance<db21a40f-ceef-4c74-949f-80b83c82f1e5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:24:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Rebasing disk image.
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:30 user nova-compute[74587]: INFO nova.compute.manager [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Took 7.33 seconds to build instance.
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ef9aaf1a-3439-49fc-91db-817dc2fd6113 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.433s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 -F raw /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 -F raw /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk" returned: 0 in 2.744s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Ensure instance console log exists: /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Start _get_guest_xml network_info=[{"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f16e178f4444550647c18d560839ba06',container_format='bare',created_at=2023-10-18T07:22:33Z,direct_url=<?>,disk_format='qcow2',id=347a56e0-4d2c-411b-9695-23356f80f1ed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1244513542-shelved',owner='35bbc4b5dcf34f2a8eedb939389e7234',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T07:22:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:24:33 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:24:33 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f16e178f4444550647c18d560839ba06',container_format='bare',created_at=2023-10-18T07:22:33Z,direct_url=<?>,disk_format='qcow2',id=347a56e0-4d2c-411b-9695-23356f80f1ed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1244513542-shelved',owner='35bbc4b5dcf34f2a8eedb939389e7234',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T07:22:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'vcpu_model' on Instance uuid db21a40f-ceef-4c74-949f-80b83c82f1e5 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.objects.base [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Object Instance<db21a40f-ceef-4c74-949f-80b83c82f1e5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1244513542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1244513542',id=25,image_ref='347a56e0-4d2c-411b-9695-23356f80f1ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1932888942',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-y1fpij3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member',shelved_at='2023-10-18T07:22:38.282467',shelved_host='user',shelved_image_id='347a56e0-4d2c-411b-9695-23356f80f1ed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=db21a40f-ceef-4c74-949f-80b83c82f1e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'pci_devices' on Instance uuid db21a40f-ceef-4c74-949f-80b83c82f1e5 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.objects.base [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Object Instance<db21a40f-ceef-4c74-949f-80b83c82f1e5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:24:33 user nova-compute[74587]:   <uuid>db21a40f-ceef-4c74-949f-80b83c82f1e5</uuid>
Oct 18 07:24:33 user nova-compute[74587]:   <name>instance-00000019</name>
Oct 18 07:24:33 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:24:33 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:24:33 user nova-compute[74587]:   <metadata>
Oct 18 07:24:33 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:24:33 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:24:33 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1244513542</nova:name>
Oct 18 07:24:33 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:24:33</nova:creationTime>
Oct 18 07:24:33 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:24:33 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:24:33 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:24:33 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:24:33 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:24:33 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:24:33 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:24:33 user nova-compute[74587]:       <nova:owner>
Oct 18 07:24:33 user nova-compute[74587]:         <nova:user uuid="af9278b67f224f1695c90223a4dc1181">tempest-AttachVolumeShelveTestJSON-1000148669-project-member</nova:user>
Oct 18 07:24:33 user nova-compute[74587]:         <nova:project uuid="35bbc4b5dcf34f2a8eedb939389e7234">tempest-AttachVolumeShelveTestJSON-1000148669</nova:project>
Oct 18 07:24:33 user nova-compute[74587]:       </nova:owner>
Oct 18 07:24:33 user nova-compute[74587]:       <nova:root type="image" uuid="347a56e0-4d2c-411b-9695-23356f80f1ed"/>
Oct 18 07:24:33 user nova-compute[74587]:       <nova:ports>
Oct 18 07:24:33 user nova-compute[74587]:         <nova:port uuid="6b0a10ff-6fe0-4564-b1ea-29cc81f01924">
Oct 18 07:24:33 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 07:24:33 user nova-compute[74587]:         </nova:port>
Oct 18 07:24:33 user nova-compute[74587]:       </nova:ports>
Oct 18 07:24:33 user nova-compute[74587]:     </nova:instance>
Oct 18 07:24:33 user nova-compute[74587]:   </metadata>
Oct 18 07:24:33 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:24:33 user nova-compute[74587]:     <system>
Oct 18 07:24:33 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:24:33 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:24:33 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:24:33 user nova-compute[74587]:       <entry name="serial">db21a40f-ceef-4c74-949f-80b83c82f1e5</entry>
Oct 18 07:24:33 user nova-compute[74587]:       <entry name="uuid">db21a40f-ceef-4c74-949f-80b83c82f1e5</entry>
Oct 18 07:24:33 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:24:33 user nova-compute[74587]:     </system>
Oct 18 07:24:33 user nova-compute[74587]:   </sysinfo>
Oct 18 07:24:33 user nova-compute[74587]:   <os>
Oct 18 07:24:33 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:24:33 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:24:33 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:24:33 user nova-compute[74587]:   </os>
Oct 18 07:24:33 user nova-compute[74587]:   <features>
Oct 18 07:24:33 user nova-compute[74587]:     <acpi/>
Oct 18 07:24:33 user nova-compute[74587]:     <apic/>
Oct 18 07:24:33 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:24:33 user nova-compute[74587]:   </features>
Oct 18 07:24:33 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:24:33 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:24:33 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:24:33 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:24:33 user nova-compute[74587]:   </clock>
Oct 18 07:24:33 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:24:33 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:24:33 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:24:33 user nova-compute[74587]:   </cpu>
Oct 18 07:24:33 user nova-compute[74587]:   <devices>
Oct 18 07:24:33 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:24:33 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:24:33 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk"/>
Oct 18 07:24:33 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:24:33 user nova-compute[74587]:     </disk>
Oct 18 07:24:33 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:24:33 user nova-compute[74587]:       <mac address="fa:16:3e:b9:ef:f7"/>
Oct 18 07:24:33 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:24:33 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:24:33 user nova-compute[74587]:       <target dev="tap6b0a10ff-6f"/>
Oct 18 07:24:33 user nova-compute[74587]:     </interface>
Oct 18 07:24:33 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:24:33 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/console.log" append="off"/>
Oct 18 07:24:33 user nova-compute[74587]:     </serial>
Oct 18 07:24:33 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:24:33 user nova-compute[74587]:     <video>
Oct 18 07:24:33 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:24:33 user nova-compute[74587]:     </video>
Oct 18 07:24:33 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:24:33 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:24:33 user nova-compute[74587]:     </rng>
Oct 18 07:24:33 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:24:33 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:24:33 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:24:33 user nova-compute[74587]:     </memballoon>
Oct 18 07:24:33 user nova-compute[74587]:   </devices>
Oct 18 07:24:33 user nova-compute[74587]: </domain>
Oct 18 07:24:33 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1244513542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1244513542',id=25,image_ref='347a56e0-4d2c-411b-9695-23356f80f1ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1932888942',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-y1fpij3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member',shelved_at='2023-10-18T07:22:38.282467',shelved_host='user',shelved_image_id='347a56e0-4d2c-411b-9695-23356f80f1ed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=db21a40f-ceef-4c74-949f-80b83c82f1e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG os_vif [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d1989a1-1371-5aec-aa49-ef2231d14129', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b0a10ff-6f, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b0a10ff-6f, col_values=(('qos', UUID('ad0d15e0-c6d2-4f1c-952c-651ad1456afc')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b0a10ff-6f, col_values=(('external_ids', {'iface-id': '6b0a10ff-6fe0-4564-b1ea-29cc81f01924', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:ef:f7', 'vm-uuid': 'db21a40f-ceef-4c74-949f-80b83c82f1e5'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:33 user nova-compute[74587]: INFO os_vif [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f')
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:24:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] No VIF found with MAC fa:16:3e:b9:ef:f7, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:24:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-b9332c8f-a6fc-4051-b17c-a9705d325923 req-f709b407-deb0-4c70-9642-de3befc5eb16 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b9332c8f-a6fc-4051-b17c-a9705d325923 req-f709b407-deb0-4c70-9642-de3befc5eb16 service nova] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b9332c8f-a6fc-4051-b17c-a9705d325923 req-f709b407-deb0-4c70-9642-de3befc5eb16 service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b9332c8f-a6fc-4051-b17c-a9705d325923 req-f709b407-deb0-4c70-9642-de3befc5eb16 service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-b9332c8f-a6fc-4051-b17c-a9705d325923 req-f709b407-deb0-4c70-9642-de3befc5eb16 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] No waiting events found dispatching network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:35 user nova-compute[74587]: WARNING nova.compute.manager [req-b9332c8f-a6fc-4051-b17c-a9705d325923 req-f709b407-deb0-4c70-9642-de3befc5eb16 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received unexpected event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 07:24:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-08aad77a-4374-41b6-8504-21238083ba81 req-27060213-ca43-4b09-8748-11f848aa93d9 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-08aad77a-4374-41b6-8504-21238083ba81 req-27060213-ca43-4b09-8748-11f848aa93d9 service nova] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-08aad77a-4374-41b6-8504-21238083ba81 req-27060213-ca43-4b09-8748-11f848aa93d9 service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-08aad77a-4374-41b6-8504-21238083ba81 req-27060213-ca43-4b09-8748-11f848aa93d9 service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-08aad77a-4374-41b6-8504-21238083ba81 req-27060213-ca43-4b09-8748-11f848aa93d9 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] No waiting events found dispatching network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:37 user nova-compute[74587]: WARNING nova.compute.manager [req-08aad77a-4374-41b6-8504-21238083ba81 req-27060213-ca43-4b09-8748-11f848aa93d9 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received unexpected event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 07:24:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:24:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:24:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Instance spawned successfully.
Oct 18 07:24:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:24:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4640f6fa-ebaa-41f6-b63a-8bd8e6e2216f tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.639s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:24:43 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Creating image(s)
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Ensure instance console log exists: /opt/stack/data/nova/instances/92ab75dd-21c4-4067-9e9a-6a86861bcfea/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Start _get_guest_xml network_info=[{"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-18T07:24:07Z,direct_url=<?>,disk_format='qcow2',id=ec73159d-30ef-4a07-abeb-61ed19b29335,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1839961656',owner='f1cfa00773ba4c5498c56b84ccb307a9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-18T07:24:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '05f4f36e-4f6b-4998-bebd-f03dfee32477', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGetmSYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '92ab75dd-21c4-4067-9e9a-6a86861bcfea', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd9b926b-1eb1-4a27-ae88-699789649920', 'serial': 'fd9b926b-1eb1-4a27-ae88-699789649920'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:24:43 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:24:43 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-18T07:24:07Z,direct_url=<?>,disk_format='qcow2',id=ec73159d-30ef-4a07-abeb-61ed19b29335,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1839961656',owner='f1cfa00773ba4c5498c56b84ccb307a9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-18T07:24:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGetmSYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:24:43 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:24:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:24:43 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:24:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:24:43 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4d937c-39dd-46d1-a99f-1800a2654045]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:24:43 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca901548-1255-4e64-8f94-a13de222d11e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920] added
Oct 18 07:24:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9a0734-5cc6-4ffe-96c0-d4050321960d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[53113828-03b1-4542-b84b-203e60ad4264]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGetmSYn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGetmSYn" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea45f96-ffac-40c8-9bbe-f5756a2ff72c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CGetmSYn'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c179b334-371c-4f9a-bfad-2dfcb85d6341]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[caef6f0e-0f13-4575-99d2-38eeba232df3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:24:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:24:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aed33d1-b02a-4869-b3d3-143fd49b412c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920, portal: 172.16.0.220,3260]
Oct 18 07:24:44 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920, portal: 172.16.0.220,3260] successful.
Oct 18 07:24:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b0144b-9e6b-41a0-8d65-03819092ac98]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f71487-f435-48a1-ab0b-2e7467881cb6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)
Oct 18 07:24:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:24:44 user nova-compute[74587]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)
Oct 18 07:24:44 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1464f4-5295-4ed9-aa38-788242d26157]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:44 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGetmSYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26634346436663739', 'path': '/dev/sde'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634346436663739', 'path': '/dev/sde'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1646355358',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1646355358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1646355358',id=29,image_ref='ec73159d-30ef-4a07-abeb-61ed19b29335',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoZdfhIF0Y93q4Mac7SIDDJXsqoklQdIbIllnmWfUXQKr525UrGU9Gvq2MC7PFNg05uhN76zDyWeq6MHmzzxsADFhmyl1j3KfvgKzhK/7/iri59ne4J7pSfa9+1RF3fAQ==',key_name='tempest-keypair-1306027815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-r2gcdplb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1301266373',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=92ab75dd-21c4-4067-9e9a-6a86861bcfea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:67:a1,bridge_name='br-int',has_traffic_filtering=True,id=83696a27-5180-489d-979c-adf769267f90,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83696a27-51') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lazy-loading 'pci_devices' on Instance uuid 92ab75dd-21c4-4067-9e9a-6a86861bcfea {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:24:45 user nova-compute[74587]:   <uuid>92ab75dd-21c4-4067-9e9a-6a86861bcfea</uuid>
Oct 18 07:24:45 user nova-compute[74587]:   <name>instance-0000001d</name>
Oct 18 07:24:45 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:24:45 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:24:45 user nova-compute[74587]:   <metadata>
Oct 18 07:24:45 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:24:45 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:24:45 user nova-compute[74587]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1646355358</nova:name>
Oct 18 07:24:45 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:24:43</nova:creationTime>
Oct 18 07:24:45 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:24:45 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:24:45 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:24:45 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:24:45 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:24:45 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:24:45 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:24:45 user nova-compute[74587]:       <nova:owner>
Oct 18 07:24:45 user nova-compute[74587]:         <nova:user uuid="d13de789e98e4ba9ad22d665ff8e4ddd">tempest-TestVolumeBootPattern-1301266373-project-member</nova:user>
Oct 18 07:24:45 user nova-compute[74587]:         <nova:project uuid="f1cfa00773ba4c5498c56b84ccb307a9">tempest-TestVolumeBootPattern-1301266373</nova:project>
Oct 18 07:24:45 user nova-compute[74587]:       </nova:owner>
Oct 18 07:24:45 user nova-compute[74587]:       <nova:root type="image" uuid="ec73159d-30ef-4a07-abeb-61ed19b29335"/>
Oct 18 07:24:45 user nova-compute[74587]:       <nova:ports>
Oct 18 07:24:45 user nova-compute[74587]:         <nova:port uuid="83696a27-5180-489d-979c-adf769267f90">
Oct 18 07:24:45 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 07:24:45 user nova-compute[74587]:         </nova:port>
Oct 18 07:24:45 user nova-compute[74587]:       </nova:ports>
Oct 18 07:24:45 user nova-compute[74587]:     </nova:instance>
Oct 18 07:24:45 user nova-compute[74587]:   </metadata>
Oct 18 07:24:45 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:24:45 user nova-compute[74587]:     <system>
Oct 18 07:24:45 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:24:45 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:24:45 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:24:45 user nova-compute[74587]:       <entry name="serial">92ab75dd-21c4-4067-9e9a-6a86861bcfea</entry>
Oct 18 07:24:45 user nova-compute[74587]:       <entry name="uuid">92ab75dd-21c4-4067-9e9a-6a86861bcfea</entry>
Oct 18 07:24:45 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:24:45 user nova-compute[74587]:     </system>
Oct 18 07:24:45 user nova-compute[74587]:   </sysinfo>
Oct 18 07:24:45 user nova-compute[74587]:   <os>
Oct 18 07:24:45 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:24:45 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:24:45 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:24:45 user nova-compute[74587]:   </os>
Oct 18 07:24:45 user nova-compute[74587]:   <features>
Oct 18 07:24:45 user nova-compute[74587]:     <acpi/>
Oct 18 07:24:45 user nova-compute[74587]:     <apic/>
Oct 18 07:24:45 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:24:45 user nova-compute[74587]:   </features>
Oct 18 07:24:45 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:24:45 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:24:45 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:24:45 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:24:45 user nova-compute[74587]:   </clock>
Oct 18 07:24:45 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:24:45 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:24:45 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:24:45 user nova-compute[74587]:   </cpu>
Oct 18 07:24:45 user nova-compute[74587]:   <devices>
Oct 18 07:24:45 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:24:45 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:24:45 user nova-compute[74587]:       <source dev="/dev/sde"/>
Oct 18 07:24:45 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:24:45 user nova-compute[74587]:       <serial>fd9b926b-1eb1-4a27-ae88-699789649920</serial>
Oct 18 07:24:45 user nova-compute[74587]:     </disk>
Oct 18 07:24:45 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:24:45 user nova-compute[74587]:       <mac address="fa:16:3e:5a:67:a1"/>
Oct 18 07:24:45 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:24:45 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:24:45 user nova-compute[74587]:       <target dev="tap83696a27-51"/>
Oct 18 07:24:45 user nova-compute[74587]:     </interface>
Oct 18 07:24:45 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:24:45 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/92ab75dd-21c4-4067-9e9a-6a86861bcfea/console.log" append="off"/>
Oct 18 07:24:45 user nova-compute[74587]:     </serial>
Oct 18 07:24:45 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:24:45 user nova-compute[74587]:     <video>
Oct 18 07:24:45 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:24:45 user nova-compute[74587]:     </video>
Oct 18 07:24:45 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:24:45 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:24:45 user nova-compute[74587]:     </rng>
Oct 18 07:24:45 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:24:45 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:24:45 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:24:45 user nova-compute[74587]:     </memballoon>
Oct 18 07:24:45 user nova-compute[74587]:   </devices>
Oct 18 07:24:45 user nova-compute[74587]: </domain>
Oct 18 07:24:45 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1646355358',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1646355358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1646355358',id=29,image_ref='ec73159d-30ef-4a07-abeb-61ed19b29335',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoZdfhIF0Y93q4Mac7SIDDJXsqoklQdIbIllnmWfUXQKr525UrGU9Gvq2MC7PFNg05uhN76zDyWeq6MHmzzxsADFhmyl1j3KfvgKzhK/7/iri59ne4J7pSfa9+1RF3fAQ==',key_name='tempest-keypair-1306027815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-r2gcdplb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1301266373',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=92ab75dd-21c4-4067-9e9a-6a86861bcfea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:67:a1,bridge_name='br-int',has_traffic_filtering=True,id=83696a27-5180-489d-979c-adf769267f90,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83696a27-51') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG os_vif [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:67:a1,bridge_name='br-int',has_traffic_filtering=True,id=83696a27-5180-489d-979c-adf769267f90,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83696a27-51') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '441b4249-3614-5364-be8d-d4fcb2aca1e9', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83696a27-51, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83696a27-51, col_values=(('qos', UUID('7cfde798-6953-4d2d-a1eb-d9ecca146009')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83696a27-51, col_values=(('external_ids', {'iface-id': '83696a27-5180-489d-979c-adf769267f90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:67:a1', 'vm-uuid': '92ab75dd-21c4-4067-9e9a-6a86861bcfea'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:45 user nova-compute[74587]: INFO os_vif [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:67:a1,bridge_name='br-int',has_traffic_filtering=True,id=83696a27-5180-489d-979c-adf769267f90,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83696a27-51')
Oct 18 07:24:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:45 user nova-compute[74587]: INFO nova.compute.manager [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Terminating instance
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] No VIF found with MAC fa:16:3e:5a:67:a1, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-b6edf81c-e37d-436a-9a91-7ff9bebb3daf req-cf1f5561-a34e-415e-8904-5608d19cf1c3 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-unplugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b6edf81c-e37d-436a-9a91-7ff9bebb3daf req-cf1f5561-a34e-415e-8904-5608d19cf1c3 service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b6edf81c-e37d-436a-9a91-7ff9bebb3daf req-cf1f5561-a34e-415e-8904-5608d19cf1c3 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b6edf81c-e37d-436a-9a91-7ff9bebb3daf req-cf1f5561-a34e-415e-8904-5608d19cf1c3 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-b6edf81c-e37d-436a-9a91-7ff9bebb3daf req-cf1f5561-a34e-415e-8904-5608d19cf1c3 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-unplugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-b6edf81c-e37d-436a-9a91-7ff9bebb3daf req-cf1f5561-a34e-415e-8904-5608d19cf1c3 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-unplugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:24:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Instance destroyed successfully.
Oct 18 07:24:46 user nova-compute[74587]: DEBUG nova.objects.instance [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lazy-loading 'resources' on Instance uuid 0d568195-c89b-47e8-9992-bfc3a6c8e929 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1612933739',display_name='tempest-ServerRescueNegativeTestJSON-server-1612933739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1612933739',id=1,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:12:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b1dbea9d8d34471b74b5c002f5905f0',ramdisk_id='',reservation_id='r-ungvr3bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1222499333',owner_user_name='tempest-ServerRescueNegativeTestJSON-1222499333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:13:57Z,user_data=None,user_id='96efd41052434514aea7fe47a5eb36f7',uuid=0d568195-c89b-47e8-9992-bfc3a6c8e929,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converting VIF {"id": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "address": "fa:16:3e:5f:50:bd", "network": {"id": "5c62aa70-ef60-4b72-8930-d05aa810242f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283687805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b1dbea9d8d34471b74b5c002f5905f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338116e1-ec", "ovs_interfaceid": "338116e1-ec57-4c95-987e-d6d72a2b50b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:50:bd,bridge_name='br-int',has_traffic_filtering=True,id=338116e1-ec57-4c95-987e-d6d72a2b50b3,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338116e1-ec') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG os_vif [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:50:bd,bridge_name='br-int',has_traffic_filtering=True,id=338116e1-ec57-4c95-987e-d6d72a2b50b3,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338116e1-ec') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap338116e1-ec, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d20d6fd-301d-4c4f-988a-05f42a5ab3af) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:46 user nova-compute[74587]: INFO os_vif [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:50:bd,bridge_name='br-int',has_traffic_filtering=True,id=338116e1-ec57-4c95-987e-d6d72a2b50b3,network=Network(5c62aa70-ef60-4b72-8930-d05aa810242f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338116e1-ec')
Oct 18 07:24:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Deleting instance files /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929_del
Oct 18 07:24:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Deletion of /opt/stack/data/nova/instances/0d568195-c89b-47e8-9992-bfc3a6c8e929_del complete
Oct 18 07:24:46 user nova-compute[74587]: INFO nova.compute.manager [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Took 1.46 seconds to destroy the instance on the hypervisor.
Oct 18 07:24:46 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:24:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:47 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Took 0.62 seconds to deallocate network for instance.
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] Acquiring lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] No waiting events found dispatching network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:47 user nova-compute[74587]: WARNING nova.compute.manager [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received unexpected event network-vif-plugged-338116e1-ec57-4c95-987e-d6d72a2b50b3 for instance with vm_state deleted and task_state None.
Oct 18 07:24:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received event network-vif-plugged-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] Acquiring lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] No waiting events found dispatching network-vif-plugged-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:47 user nova-compute[74587]: WARNING nova.compute.manager [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received unexpected event network-vif-plugged-83696a27-5180-489d-979c-adf769267f90 for instance with vm_state building and task_state spawning.
Oct 18 07:24:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] [instance: 0d568195-c89b-47e8-9992-bfc3a6c8e929] Received event network-vif-deleted-338116e1-ec57-4c95-987e-d6d72a2b50b3 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received event network-vif-plugged-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] Acquiring lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] No waiting events found dispatching network-vif-plugged-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:47 user nova-compute[74587]: WARNING nova.compute.manager [req-21369cb9-075f-451f-8c41-668d34f74664 req-e14eda8d-d535-4c00-b1de-79d004607633 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received unexpected event network-vif-plugged-83696a27-5180-489d-979c-adf769267f90 for instance with vm_state building and task_state spawning.
Oct 18 07:24:47 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:24:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:47 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Deleted allocations for instance 0d568195-c89b-47e8-9992-bfc3a6c8e929
Oct 18 07:24:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-068021fc-b0e3-4aaf-9805-5918f09cfc96 tempest-ServerRescueNegativeTestJSON-1222499333 tempest-ServerRescueNegativeTestJSON-1222499333-project-member] Lock "0d568195-c89b-47e8-9992-bfc3a6c8e929" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.986s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:24:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:24:49 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Instance spawned successfully.
Oct 18 07:24:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:24:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:24:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:24:49 user nova-compute[74587]: INFO nova.compute.manager [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Took 5.50 seconds to spawn the instance on the hypervisor.
Oct 18 07:24:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:24:49 user nova-compute[74587]: INFO nova.compute.manager [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Took 30.50 seconds to build instance.
Oct 18 07:24:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c7617649-3d12-4cdf-aea1-758b3bc4f76b tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.588s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:56 user nova-compute[74587]: INFO nova.compute.manager [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Terminating instance
Oct 18 07:24:56 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-35dbc272-c628-486d-a0f0-b2af8c050eea req-d3cfffb7-8018-4b44-9ff1-887427b59c7a service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-vif-unplugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-35dbc272-c628-486d-a0f0-b2af8c050eea req-d3cfffb7-8018-4b44-9ff1-887427b59c7a service nova] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-35dbc272-c628-486d-a0f0-b2af8c050eea req-d3cfffb7-8018-4b44-9ff1-887427b59c7a service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-35dbc272-c628-486d-a0f0-b2af8c050eea req-d3cfffb7-8018-4b44-9ff1-887427b59c7a service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-35dbc272-c628-486d-a0f0-b2af8c050eea req-d3cfffb7-8018-4b44-9ff1-887427b59c7a service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] No waiting events found dispatching network-vif-unplugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-35dbc272-c628-486d-a0f0-b2af8c050eea req-d3cfffb7-8018-4b44-9ff1-887427b59c7a service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-vif-unplugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Instance destroyed successfully.
Oct 18 07:24:56 user nova-compute[74587]: DEBUG nova.objects.instance [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lazy-loading 'resources' on Instance uuid a61094a5-cbd8-4dd1-9514-d22cffb95d37 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-608502183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1188491975',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb7AWTCUJMtWT+b6CO+0sC3i+/8jyR2wEzLDh9dRK0WqLzka8rM6W/97aV9qlO5Rr3hf8np+xqTDyEmyct3btj/WZrRH3GWfTzWe8m6/GmXDuKx72pEDYM8Ze3f2yy1+Q==',key_name='tempest-keypair-1211237030',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:23:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99d9c959e5f6494d82b4fae0fb9123f3',ramdisk_id='',reservation_id='r-x8yh5wgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-474901938',owner_user_name='tempest-ServerActionsV293TestJSON-474901938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:23:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d72c3d757ed49adafd674fb5ee1e44f',uuid=a61094a5-cbd8-4dd1-9514-d22cffb95d37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converting VIF {"id": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "address": "fa:16:3e:ec:4b:38", "network": {"id": "5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1741089694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d9c959e5f6494d82b4fae0fb9123f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4ce1ba-92", "ovs_interfaceid": "fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_vif [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc4ce1ba-92, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efc9a2f2-a478-4034-b610-b24a7128bd70) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:56 user nova-compute[74587]: INFO os_vif [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:4b:38,bridge_name='br-int',has_traffic_filtering=True,id=fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2,network=Network(5d6d2f5a-6082-4fa4-b7d3-3a8ccb43a981),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4ce1ba-92')
Oct 18 07:24:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuGrcIVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:24:56 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2cfec2-2352-4549-beda-b57110660859]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:24:56 user nova-compute[74587]: No targets found.
Oct 18 07:24:56 user nova-compute[74587]: iSNS:
Oct 18 07:24:56 user nova-compute[74587]: No targets found.
Oct 18 07:24:56 user nova-compute[74587]: STATIC:
Oct 18 07:24:56 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:24:56 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:24:56 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:24:56 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da
Oct 18 07:24:56 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:24:56 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:24:56 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920
Oct 18 07:24:56 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:24:56 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:24:56 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:24:56 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:24:56 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:24:56 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a
Oct 18 07:24:56 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:24:56 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:24:56 user nova-compute[74587]: FIRMWARE:
Oct 18 07:24:56 user nova-compute[74587]: No targets found.
Oct 18 07:24:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:24:56 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:24:56 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1604cd-3706-45c1-88ba-b4cfedab2fe5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c6c545-d4fc-46eb-93df-b4f9366bff3b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:24:56 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:24:56 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:24:56 user nova-compute[74587]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:24:56 user nova-compute[74587]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)
Oct 18 07:24:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:24:56 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:24:56 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:24:56 user nova-compute[74587]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a (non-flash)
Oct 18 07:24:56 user nova-compute[74587]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)
Oct 18 07:24:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4657130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d4c89-4f69-43e1-8e58-602a99bbffd1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cb37eb-93a4-4184-9303-bdfdb4f6b104]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d66ab8b-3794-4a45-8296-709b6fe57cac]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:24:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3925b-6e31-422f-a853-1b85f8630b81]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23130633338323831', '/dev/disk/by-id/scsi-1SCST_BIO5299ed69-10c38281541dedf9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5299ed69') {{(pid=85802) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 18 07:24:57 user nova-compute[74587]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23130633338323831
Oct 18 07:24:57 user nova-compute[74587]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO5299ed69-10c38281541dedf9
Oct 18 07:24:57 user nova-compute[74587]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_5299ed69
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbed7df4-dfb2-4745-af12-24098839b874]: (4, None) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e0bc4d-3e4a-40ff-bd29-0266118a825e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39f7996-ddf7-420d-8f16-d9ae8d40d205]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260]
Oct 18 07:24:57 user nova-compute[74587]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a, portal: 172.16.0.220,3260] successful.
Oct 18 07:24:57 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17848046-ec39-4558-aee8-75180f56091a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bff1887-fef9-40ba-93f8-79127db9fb48]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] <== disconnect_volume: return (329ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:24:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Deleting instance files /opt/stack/data/nova/instances/a61094a5-cbd8-4dd1-9514-d22cffb95d37_del
Oct 18 07:24:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Deletion of /opt/stack/data/nova/instances/a61094a5-cbd8-4dd1-9514-d22cffb95d37_del complete
Oct 18 07:24:57 user nova-compute[74587]: INFO nova.compute.manager [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 18 07:24:57 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:24:57 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:24:57 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Took 0.71 seconds to deallocate network for instance.
Oct 18 07:24:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-40b4ccac-0ae6-426b-8ae4-7fd4555c238d req-5a2d9e9e-8540-4974-ae7a-0c528b8108a6 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-40b4ccac-0ae6-426b-8ae4-7fd4555c238d req-5a2d9e9e-8540-4974-ae7a-0c528b8108a6 service nova] Acquiring lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-40b4ccac-0ae6-426b-8ae4-7fd4555c238d req-5a2d9e9e-8540-4974-ae7a-0c528b8108a6 service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-40b4ccac-0ae6-426b-8ae4-7fd4555c238d req-5a2d9e9e-8540-4974-ae7a-0c528b8108a6 service nova] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-40b4ccac-0ae6-426b-8ae4-7fd4555c238d req-5a2d9e9e-8540-4974-ae7a-0c528b8108a6 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] No waiting events found dispatching network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:24:58 user nova-compute[74587]: WARNING nova.compute.manager [req-40b4ccac-0ae6-426b-8ae4-7fd4555c238d req-5a2d9e9e-8540-4974-ae7a-0c528b8108a6 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received unexpected event network-vif-plugged-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 for instance with vm_state active and task_state deleting.
Oct 18 07:24:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-40b4ccac-0ae6-426b-8ae4-7fd4555c238d req-5a2d9e9e-8540-4974-ae7a-0c528b8108a6 service nova] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Received event network-vif-deleted-fc4ce1ba-92b7-44ca-8b80-4ed5d3f7bfa2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:24:58 user nova-compute[74587]: INFO nova.compute.manager [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Took 0.86 seconds to detach 1 volumes for instance.
Oct 18 07:24:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] [instance: a61094a5-cbd8-4dd1-9514-d22cffb95d37] Deleting volume: 17848046-ec39-4558-aee8-75180f56091a {{(pid=74587) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 07:24:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:59 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:24:59 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:24:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:59 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Deleted allocations for instance a61094a5-cbd8-4dd1-9514-d22cffb95d37
Oct 18 07:24:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a26d050f-daea-44c8-9f5e-885ae16a8c43 tempest-ServerActionsV293TestJSON-474901938 tempest-ServerActionsV293TestJSON-474901938-project-member] Lock "a61094a5-cbd8-4dd1-9514-d22cffb95d37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.408s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:24:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "bf09a68d-be43-42a5-a1d3-376714e16770" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:24:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "bf09a68d-be43-42a5-a1d3-376714e16770" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:24:59 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:25:00 user nova-compute[74587]: INFO nova.compute.claims [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Claim successful on node user
Oct 18 07:25:00 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:25:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:25:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG nova.policy [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '968bb444a9524dab94f28aa7ffab2305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e52872350444fd954e9fea9743b118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:25:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Creating image(s)
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "/opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "/opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.201s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Successfully created port: 206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.218s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk 1073741824" returned: 0 in 0.053s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Cannot resize image /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Ensure instance console log exists: /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Successfully updated port: 206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "refresh_cache-bf09a68d-be43-42a5-a1d3-376714e16770" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquired lock "refresh_cache-bf09a68d-be43-42a5-a1d3-376714e16770" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-bcdc6428-1ef8-4ca4-b43b-6c1d542dc526 req-510adbb7-89f5-4476-968b-381bdf76d1d5 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Received event network-changed-206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-bcdc6428-1ef8-4ca4-b43b-6c1d542dc526 req-510adbb7-89f5-4476-968b-381bdf76d1d5 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Refreshing instance network info cache due to event network-changed-206b0110-99cd-4cd6-b357-5c777d9149de. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcdc6428-1ef8-4ca4-b43b-6c1d542dc526 req-510adbb7-89f5-4476-968b-381bdf76d1d5 service nova] Acquiring lock "refresh_cache-bf09a68d-be43-42a5-a1d3-376714e16770" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:01 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Updating instance_info_cache with network_info: [{"id": "206b0110-99cd-4cd6-b357-5c777d9149de", "address": "fa:16:3e:de:fc:8d", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206b0110-99", "ovs_interfaceid": "206b0110-99cd-4cd6-b357-5c777d9149de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Releasing lock "refresh_cache-bf09a68d-be43-42a5-a1d3-376714e16770" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Instance network_info: |[{"id": "206b0110-99cd-4cd6-b357-5c777d9149de", "address": "fa:16:3e:de:fc:8d", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206b0110-99", "ovs_interfaceid": "206b0110-99cd-4cd6-b357-5c777d9149de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcdc6428-1ef8-4ca4-b43b-6c1d542dc526 req-510adbb7-89f5-4476-968b-381bdf76d1d5 service nova] Acquired lock "refresh_cache-bf09a68d-be43-42a5-a1d3-376714e16770" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-bcdc6428-1ef8-4ca4-b43b-6c1d542dc526 req-510adbb7-89f5-4476-968b-381bdf76d1d5 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Refreshing network info cache for port 206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Start _get_guest_xml network_info=[{"id": "206b0110-99cd-4cd6-b357-5c777d9149de", "address": "fa:16:3e:de:fc:8d", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206b0110-99", "ovs_interfaceid": "206b0110-99cd-4cd6-b357-5c777d9149de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:25:02 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:25:02 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-429856399',display_name='tempest-ServersNegativeTestJSON-server-429856399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-429856399',id=31,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e52872350444fd954e9fea9743b118',ramdisk_id='',reservation_id='r-2v7vi4c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-766120743',owner_user_name='tempest-ServersNegativeTestJSON-766120743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:25:01Z,user_data=None,user_id='968bb444a9524dab94f28aa7ffab2305',uuid=bf09a68d-be43-42a5-a1d3-376714e16770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "206b0110-99cd-4cd6-b357-5c777d9149de", "address": "fa:16:3e:de:fc:8d", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206b0110-99", "ovs_interfaceid": "206b0110-99cd-4cd6-b357-5c777d9149de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converting VIF {"id": "206b0110-99cd-4cd6-b357-5c777d9149de", "address": "fa:16:3e:de:fc:8d", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206b0110-99", "ovs_interfaceid": "206b0110-99cd-4cd6-b357-5c777d9149de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fc:8d,bridge_name='br-int',has_traffic_filtering=True,id=206b0110-99cd-4cd6-b357-5c777d9149de,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206b0110-99') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.objects.instance [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lazy-loading 'pci_devices' on Instance uuid bf09a68d-be43-42a5-a1d3-376714e16770 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:25:02 user nova-compute[74587]:   <uuid>bf09a68d-be43-42a5-a1d3-376714e16770</uuid>
Oct 18 07:25:02 user nova-compute[74587]:   <name>instance-0000001f</name>
Oct 18 07:25:02 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:25:02 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:25:02 user nova-compute[74587]:   <metadata>
Oct 18 07:25:02 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:25:02 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:25:02 user nova-compute[74587]:       <nova:name>tempest-ServersNegativeTestJSON-server-429856399</nova:name>
Oct 18 07:25:02 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:25:02</nova:creationTime>
Oct 18 07:25:02 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:25:02 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:25:02 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:25:02 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:25:02 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:25:02 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:25:02 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:25:02 user nova-compute[74587]:       <nova:owner>
Oct 18 07:25:02 user nova-compute[74587]:         <nova:user uuid="968bb444a9524dab94f28aa7ffab2305">tempest-ServersNegativeTestJSON-766120743-project-member</nova:user>
Oct 18 07:25:02 user nova-compute[74587]:         <nova:project uuid="88e52872350444fd954e9fea9743b118">tempest-ServersNegativeTestJSON-766120743</nova:project>
Oct 18 07:25:02 user nova-compute[74587]:       </nova:owner>
Oct 18 07:25:02 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:25:02 user nova-compute[74587]:       <nova:ports>
Oct 18 07:25:02 user nova-compute[74587]:         <nova:port uuid="206b0110-99cd-4cd6-b357-5c777d9149de">
Oct 18 07:25:02 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 07:25:02 user nova-compute[74587]:         </nova:port>
Oct 18 07:25:02 user nova-compute[74587]:       </nova:ports>
Oct 18 07:25:02 user nova-compute[74587]:     </nova:instance>
Oct 18 07:25:02 user nova-compute[74587]:   </metadata>
Oct 18 07:25:02 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:25:02 user nova-compute[74587]:     <system>
Oct 18 07:25:02 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:25:02 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:25:02 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:25:02 user nova-compute[74587]:       <entry name="serial">bf09a68d-be43-42a5-a1d3-376714e16770</entry>
Oct 18 07:25:02 user nova-compute[74587]:       <entry name="uuid">bf09a68d-be43-42a5-a1d3-376714e16770</entry>
Oct 18 07:25:02 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:25:02 user nova-compute[74587]:     </system>
Oct 18 07:25:02 user nova-compute[74587]:   </sysinfo>
Oct 18 07:25:02 user nova-compute[74587]:   <os>
Oct 18 07:25:02 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:25:02 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:25:02 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:25:02 user nova-compute[74587]:   </os>
Oct 18 07:25:02 user nova-compute[74587]:   <features>
Oct 18 07:25:02 user nova-compute[74587]:     <acpi/>
Oct 18 07:25:02 user nova-compute[74587]:     <apic/>
Oct 18 07:25:02 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:25:02 user nova-compute[74587]:   </features>
Oct 18 07:25:02 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:25:02 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:25:02 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:25:02 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:25:02 user nova-compute[74587]:   </clock>
Oct 18 07:25:02 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:25:02 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:25:02 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:25:02 user nova-compute[74587]:   </cpu>
Oct 18 07:25:02 user nova-compute[74587]:   <devices>
Oct 18 07:25:02 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:25:02 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:25:02 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk"/>
Oct 18 07:25:02 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:25:02 user nova-compute[74587]:     </disk>
Oct 18 07:25:02 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:25:02 user nova-compute[74587]:       <mac address="fa:16:3e:de:fc:8d"/>
Oct 18 07:25:02 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:25:02 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:25:02 user nova-compute[74587]:       <target dev="tap206b0110-99"/>
Oct 18 07:25:02 user nova-compute[74587]:     </interface>
Oct 18 07:25:02 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:25:02 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/console.log" append="off"/>
Oct 18 07:25:02 user nova-compute[74587]:     </serial>
Oct 18 07:25:02 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:25:02 user nova-compute[74587]:     <video>
Oct 18 07:25:02 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:25:02 user nova-compute[74587]:     </video>
Oct 18 07:25:02 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:25:02 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:25:02 user nova-compute[74587]:     </rng>
Oct 18 07:25:02 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:25:02 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:25:02 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:25:02 user nova-compute[74587]:     </memballoon>
Oct 18 07:25:02 user nova-compute[74587]:   </devices>
Oct 18 07:25:02 user nova-compute[74587]: </domain>
Oct 18 07:25:02 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-429856399',display_name='tempest-ServersNegativeTestJSON-server-429856399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-429856399',id=31,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e52872350444fd954e9fea9743b118',ramdisk_id='',reservation_id='r-2v7vi4c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-766120743',owner_user_name='tempest-ServersNegativeTestJSON-766120743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:25:01Z,user_data=None,user_id='968bb444a9524dab94f28aa7ffab2305',uuid=bf09a68d-be43-42a5-a1d3-376714e16770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "206b0110-99cd-4cd6-b357-5c777d9149de", "address": "fa:16:3e:de:fc:8d", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206b0110-99", "ovs_interfaceid": "206b0110-99cd-4cd6-b357-5c777d9149de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converting VIF {"id": "206b0110-99cd-4cd6-b357-5c777d9149de", "address": "fa:16:3e:de:fc:8d", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206b0110-99", "ovs_interfaceid": "206b0110-99cd-4cd6-b357-5c777d9149de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fc:8d,bridge_name='br-int',has_traffic_filtering=True,id=206b0110-99cd-4cd6-b357-5c777d9149de,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206b0110-99') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG os_vif [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fc:8d,bridge_name='br-int',has_traffic_filtering=True,id=206b0110-99cd-4cd6-b357-5c777d9149de,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206b0110-99') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79ec84f4-1a64-5d2c-aa49-02e63b4578b2', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap206b0110-99, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap206b0110-99, col_values=(('qos', UUID('65ed788e-057f-412d-b63a-c7e1d204a36a')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap206b0110-99, col_values=(('external_ids', {'iface-id': '206b0110-99cd-4cd6-b357-5c777d9149de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:fc:8d', 'vm-uuid': 'bf09a68d-be43-42a5-a1d3-376714e16770'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:02 user nova-compute[74587]: INFO os_vif [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fc:8d,bridge_name='br-int',has_traffic_filtering=True,id=206b0110-99cd-4cd6-b357-5c777d9149de,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206b0110-99')
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] No VIF found with MAC fa:16:3e:de:fc:8d, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-bcdc6428-1ef8-4ca4-b43b-6c1d542dc526 req-510adbb7-89f5-4476-968b-381bdf76d1d5 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Updated VIF entry in instance network info cache for port 206b0110-99cd-4cd6-b357-5c777d9149de. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-bcdc6428-1ef8-4ca4-b43b-6c1d542dc526 req-510adbb7-89f5-4476-968b-381bdf76d1d5 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Updating instance_info_cache with network_info: [{"id": "206b0110-99cd-4cd6-b357-5c777d9149de", "address": "fa:16:3e:de:fc:8d", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206b0110-99", "ovs_interfaceid": "206b0110-99cd-4cd6-b357-5c777d9149de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:25:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcdc6428-1ef8-4ca4-b43b-6c1d542dc526 req-510adbb7-89f5-4476-968b-381bdf76d1d5 service nova] Releasing lock "refresh_cache-bf09a68d-be43-42a5-a1d3-376714e16770" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:25:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-bc4a7eb1-fbb2-4572-9bd8-58f1efba03c5 req-d197a728-40d6-479f-8f14-8aac040f2a6a service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Received event network-vif-plugged-206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:25:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bc4a7eb1-fbb2-4572-9bd8-58f1efba03c5 req-d197a728-40d6-479f-8f14-8aac040f2a6a service nova] Acquiring lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bc4a7eb1-fbb2-4572-9bd8-58f1efba03c5 req-d197a728-40d6-479f-8f14-8aac040f2a6a service nova] Lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bc4a7eb1-fbb2-4572-9bd8-58f1efba03c5 req-d197a728-40d6-479f-8f14-8aac040f2a6a service nova] Lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-bc4a7eb1-fbb2-4572-9bd8-58f1efba03c5 req-d197a728-40d6-479f-8f14-8aac040f2a6a service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] No waiting events found dispatching network-vif-plugged-206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:25:03 user nova-compute[74587]: WARNING nova.compute.manager [req-bc4a7eb1-fbb2-4572-9bd8-58f1efba03c5 req-d197a728-40d6-479f-8f14-8aac040f2a6a service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Received unexpected event network-vif-plugged-206b0110-99cd-4cd6-b357-5c777d9149de for instance with vm_state building and task_state spawning.
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:25:05 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Instance spawned successfully.
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:25:05 user nova-compute[74587]: INFO nova.compute.manager [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Took 5.16 seconds to spawn the instance on the hypervisor.
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-876bf069-37ef-4e46-9e2c-48473c472290 req-140ecb54-9eea-497f-8c02-dba2ffd906f9 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Received event network-vif-plugged-206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-876bf069-37ef-4e46-9e2c-48473c472290 req-140ecb54-9eea-497f-8c02-dba2ffd906f9 service nova] Acquiring lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-876bf069-37ef-4e46-9e2c-48473c472290 req-140ecb54-9eea-497f-8c02-dba2ffd906f9 service nova] Lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-876bf069-37ef-4e46-9e2c-48473c472290 req-140ecb54-9eea-497f-8c02-dba2ffd906f9 service nova] Lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-876bf069-37ef-4e46-9e2c-48473c472290 req-140ecb54-9eea-497f-8c02-dba2ffd906f9 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] No waiting events found dispatching network-vif-plugged-206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:25:05 user nova-compute[74587]: WARNING nova.compute.manager [req-876bf069-37ef-4e46-9e2c-48473c472290 req-140ecb54-9eea-497f-8c02-dba2ffd906f9 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Received unexpected event network-vif-plugged-206b0110-99cd-4cd6-b357-5c777d9149de for instance with vm_state building and task_state spawning.
Oct 18 07:25:06 user nova-compute[74587]: INFO nova.compute.manager [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Took 5.96 seconds to build instance.
Oct 18 07:25:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7edae18f-4b1a-4e84-b4a3-b452de67cc38 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "bf09a68d-be43-42a5-a1d3-376714e16770" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.171s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:07 user nova-compute[74587]: INFO nova.compute.manager [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Terminating instance
Oct 18 07:25:07 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-859433d2-771f-446b-94cb-1f978d6543f9 req-53d319c3-aeb6-411f-b915-eaa9535d3d3d service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-unplugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-859433d2-771f-446b-94cb-1f978d6543f9 req-53d319c3-aeb6-411f-b915-eaa9535d3d3d service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-859433d2-771f-446b-94cb-1f978d6543f9 req-53d319c3-aeb6-411f-b915-eaa9535d3d3d service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-859433d2-771f-446b-94cb-1f978d6543f9 req-53d319c3-aeb6-411f-b915-eaa9535d3d3d service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-859433d2-771f-446b-94cb-1f978d6543f9 req-53d319c3-aeb6-411f-b915-eaa9535d3d3d service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-unplugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-859433d2-771f-446b-94cb-1f978d6543f9 req-53d319c3-aeb6-411f-b915-eaa9535d3d3d service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-unplugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:08 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Instance destroyed successfully.
Oct 18 07:25:08 user nova-compute[74587]: DEBUG nova.objects.instance [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'resources' on Instance uuid f377ac1a-df76-49e1-b727-916d01a7fd02 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:19:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2083496532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2083496532',id=22,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-bcandgus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:23:22Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=f377ac1a-df76-49e1-b727-916d01a7fd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "ae030258-2fea-414a-9e11-2db1da2515f4", "address": "fa:16:3e:81:0a:47", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae030258-2f", "ovs_interfaceid": "ae030258-2fea-414a-9e11-2db1da2515f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:0a:47,bridge_name='br-int',has_traffic_filtering=True,id=ae030258-2fea-414a-9e11-2db1da2515f4,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae030258-2f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_vif [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:0a:47,bridge_name='br-int',has_traffic_filtering=True,id=ae030258-2fea-414a-9e11-2db1da2515f4,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae030258-2f') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae030258-2f, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4322525a-0c43-4937-a422-9e11a58532b4) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:08 user nova-compute[74587]: INFO os_vif [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:0a:47,bridge_name='br-int',has_traffic_filtering=True,id=ae030258-2fea-414a-9e11-2db1da2515f4,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae030258-2f')
Oct 18 07:25:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDrmwoAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:25:08 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd77df13-a985-4e58-a00f-2b2b9952aea8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:25:08 user nova-compute[74587]: No targets found.
Oct 18 07:25:08 user nova-compute[74587]: iSNS:
Oct 18 07:25:08 user nova-compute[74587]: No targets found.
Oct 18 07:25:08 user nova-compute[74587]: STATIC:
Oct 18 07:25:08 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1
Oct 18 07:25:08 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:25:08 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:25:08 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da
Oct 18 07:25:08 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:25:08 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:25:08 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920
Oct 18 07:25:08 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:25:08 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:25:08 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:25:08 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:25:08 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:25:08 user nova-compute[74587]: FIRMWARE:
Oct 18 07:25:08 user nova-compute[74587]: No targets found.
Oct 18 07:25:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:25:08 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:25:08 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ac3c93-8f42-45b1-a52c-f46d352289bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[951ff620-2310-43fa-9a1b-ba338881e250]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:25:08 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:25:08 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:25:08 user nova-compute[74587]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)
Oct 18 07:25:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:25:08 user nova-compute[74587]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 (non-flash)
Oct 18 07:25:08 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:25:08 user nova-compute[74587]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)
Oct 18 07:25:08 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46567a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1'): ({'sdf'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Removing single pathed devices sdf {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34ffa80-7972-4ab1-942d-f56423326eee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f2cd29-1be2-4b6e-a259-7bba0a29f322]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flushing IO for device /dev/sdf {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe228a3-0eb4-427f-8736-ba23f697b628]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:25:08 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.059s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef79f8b3-e1bf-4a0a-afc9-432041e68088]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] SCSI volumes sdf have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cb0c62-91cb-4308-bdf8-acf4f44e333e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46b3495-30f9-428a-94b2-04241fba9818]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1, portal: 172.16.0.220,3260]
Oct 18 07:25:09 user nova-compute[74587]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1, portal: 172.16.0.220,3260] successful.
Oct 18 07:25:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab89c35b-81e5-4b3c-8bc9-648be8bf10f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f508aa04-3e95-49f6-8766-19f35eda7bd3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] <== disconnect_volume: return (368ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:25:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Deleting instance files /opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02_del
Oct 18 07:25:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Deletion of /opt/stack/data/nova/instances/f377ac1a-df76-49e1-b727-916d01a7fd02_del complete
Oct 18 07:25:09 user nova-compute[74587]: INFO nova.compute.manager [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 18 07:25:09 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:25:09 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:25:10 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:25:10 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Took 0.80 seconds to deallocate network for instance.
Oct 18 07:25:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-eb396b00-52ce-44a2-a950-eb88710330e1 req-40fbd992-f9b8-429f-8e97-8b44fba1b57b service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-deleted-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:25:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-01eceb0f-fd9e-4e47-b26b-68434b6d4c23 req-71e38906-9e5c-4bfd-857e-c4ab54cab8ee service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:25:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-01eceb0f-fd9e-4e47-b26b-68434b6d4c23 req-71e38906-9e5c-4bfd-857e-c4ab54cab8ee service nova] Acquiring lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-01eceb0f-fd9e-4e47-b26b-68434b6d4c23 req-71e38906-9e5c-4bfd-857e-c4ab54cab8ee service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-01eceb0f-fd9e-4e47-b26b-68434b6d4c23 req-71e38906-9e5c-4bfd-857e-c4ab54cab8ee service nova] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-01eceb0f-fd9e-4e47-b26b-68434b6d4c23 req-71e38906-9e5c-4bfd-857e-c4ab54cab8ee service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] No waiting events found dispatching network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:25:10 user nova-compute[74587]: WARNING nova.compute.manager [req-01eceb0f-fd9e-4e47-b26b-68434b6d4c23 req-71e38906-9e5c-4bfd-857e-c4ab54cab8ee service nova] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Received unexpected event network-vif-plugged-ae030258-2fea-414a-9e11-2db1da2515f4 for instance with vm_state active and task_state deleting.
Oct 18 07:25:11 user nova-compute[74587]: INFO nova.compute.manager [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: f377ac1a-df76-49e1-b727-916d01a7fd02] Took 1.13 seconds to detach 1 volumes for instance.
Oct 18 07:25:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:11 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:25:11 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:25:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:11 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Deleted allocations for instance f377ac1a-df76-49e1-b727-916d01a7fd02
Oct 18 07:25:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ea7cefe4-dc9b-432c-9e0e-6164215370cf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "f377ac1a-df76-49e1-b727-916d01a7fd02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.921s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:13 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:25:13 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:25:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:25:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:25:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:25:21 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:25:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:25:26 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:25:26 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7583MB free_disk=25.036842346191406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ee7e9ad7-fe94-4031-885c-ad134624135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance af696b6e-6fc7-44ee-a514-c49f6f6b340a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 665a2f6d-4704-400e-aeca-ae8cb29333da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 92ab75dd-21c4-4067-9e9a-6a86861bcfea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance db21a40f-ceef-4c74-949f-80b83c82f1e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance bf09a68d-be43-42a5-a1d3-376714e16770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:25:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:25:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:25:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "ee7e9ad7-fe94-4031-885c-ad134624135f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:58 user nova-compute[74587]: INFO nova.compute.manager [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Terminating instance
Oct 18 07:25:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-da8e517b-f3fa-4657-9742-44e7b281d5b1 req-3c946cd5-cf32-401f-9d89-e42ac738dac2 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Received event network-vif-unplugged-a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-da8e517b-f3fa-4657-9742-44e7b281d5b1 req-3c946cd5-cf32-401f-9d89-e42ac738dac2 service nova] Acquiring lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-da8e517b-f3fa-4657-9742-44e7b281d5b1 req-3c946cd5-cf32-401f-9d89-e42ac738dac2 service nova] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-da8e517b-f3fa-4657-9742-44e7b281d5b1 req-3c946cd5-cf32-401f-9d89-e42ac738dac2 service nova] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-da8e517b-f3fa-4657-9742-44e7b281d5b1 req-3c946cd5-cf32-401f-9d89-e42ac738dac2 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] No waiting events found dispatching network-vif-unplugged-a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-da8e517b-f3fa-4657-9742-44e7b281d5b1 req-3c946cd5-cf32-401f-9d89-e42ac738dac2 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Received event network-vif-unplugged-a30d6483-8e92-4258-beab-29aa0a68844a for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:59 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Instance destroyed successfully.
Oct 18 07:25:59 user nova-compute[74587]: DEBUG nova.objects.instance [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'resources' on Instance uuid ee7e9ad7-fe94-4031-885c-ad134624135f {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1944472517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1944472517',id=19,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:16:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-9ncbd7j3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:18:33Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=ee7e9ad7-fe94-4031-885c-ad134624135f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "a30d6483-8e92-4258-beab-29aa0a68844a", "address": "fa:16:3e:b0:41:d8", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa30d6483-8e", "ovs_interfaceid": "a30d6483-8e92-4258-beab-29aa0a68844a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:41:d8,bridge_name='br-int',has_traffic_filtering=True,id=a30d6483-8e92-4258-beab-29aa0a68844a,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d6483-8e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG os_vif [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:41:d8,bridge_name='br-int',has_traffic_filtering=True,id=a30d6483-8e92-4258-beab-29aa0a68844a,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d6483-8e') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa30d6483-8e, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f27d88a-0890-44c8-8ef8-8edf2837b43c) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:25:59 user nova-compute[74587]: INFO os_vif [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:41:d8,bridge_name='br-int',has_traffic_filtering=True,id=a30d6483-8e92-4258-beab-29aa0a68844a,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa30d6483-8e')
Oct 18 07:25:59 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Deleting instance files /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f_del
Oct 18 07:25:59 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Deletion of /opt/stack/data/nova/instances/ee7e9ad7-fe94-4031-885c-ad134624135f_del complete
Oct 18 07:25:59 user nova-compute[74587]: INFO nova.compute.manager [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 18 07:25:59 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:25:59 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:26:00 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:26:00 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Took 0.50 seconds to deallocate network for instance.
Oct 18 07:26:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:00 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:26:00 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:26:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:00 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Deleted allocations for instance ee7e9ad7-fe94-4031-885c-ad134624135f
Oct 18 07:26:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6af365f7-be27-4091-a2b8-f75d86dffef1 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.072s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-b6cf1175-383f-4cb4-8caa-46ae8d54b48e req-a868a9cf-b937-4592-b53a-f4b0ecab3668 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Received event network-vif-plugged-a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b6cf1175-383f-4cb4-8caa-46ae8d54b48e req-a868a9cf-b937-4592-b53a-f4b0ecab3668 service nova] Acquiring lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b6cf1175-383f-4cb4-8caa-46ae8d54b48e req-a868a9cf-b937-4592-b53a-f4b0ecab3668 service nova] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b6cf1175-383f-4cb4-8caa-46ae8d54b48e req-a868a9cf-b937-4592-b53a-f4b0ecab3668 service nova] Lock "ee7e9ad7-fe94-4031-885c-ad134624135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-b6cf1175-383f-4cb4-8caa-46ae8d54b48e req-a868a9cf-b937-4592-b53a-f4b0ecab3668 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] No waiting events found dispatching network-vif-plugged-a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:01 user nova-compute[74587]: WARNING nova.compute.manager [req-b6cf1175-383f-4cb4-8caa-46ae8d54b48e req-a868a9cf-b937-4592-b53a-f4b0ecab3668 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Received unexpected event network-vif-plugged-a30d6483-8e92-4258-beab-29aa0a68844a for instance with vm_state deleted and task_state None.
Oct 18 07:26:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-b6cf1175-383f-4cb4-8caa-46ae8d54b48e req-a868a9cf-b937-4592-b53a-f4b0ecab3668 service nova] [instance: ee7e9ad7-fe94-4031-885c-ad134624135f] Received event network-vif-deleted-a30d6483-8e92-4258-beab-29aa0a68844a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:26:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-9e96b1e5-b052-4b5f-83f2-a406f67a487e req-fbff94a2-79a7-4347-8f5d-2bc1d2311348 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received event network-changed-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-9e96b1e5-b052-4b5f-83f2-a406f67a487e req-fbff94a2-79a7-4347-8f5d-2bc1d2311348 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Refreshing instance network info cache due to event network-changed-83696a27-5180-489d-979c-adf769267f90. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:26:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9e96b1e5-b052-4b5f-83f2-a406f67a487e req-fbff94a2-79a7-4347-8f5d-2bc1d2311348 service nova] Acquiring lock "refresh_cache-92ab75dd-21c4-4067-9e9a-6a86861bcfea" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:26:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9e96b1e5-b052-4b5f-83f2-a406f67a487e req-fbff94a2-79a7-4347-8f5d-2bc1d2311348 service nova] Acquired lock "refresh_cache-92ab75dd-21c4-4067-9e9a-6a86861bcfea" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:26:10 user nova-compute[74587]: DEBUG nova.network.neutron [req-9e96b1e5-b052-4b5f-83f2-a406f67a487e req-fbff94a2-79a7-4347-8f5d-2bc1d2311348 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Refreshing network info cache for port 83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:26:10 user nova-compute[74587]: DEBUG nova.network.neutron [req-9e96b1e5-b052-4b5f-83f2-a406f67a487e req-fbff94a2-79a7-4347-8f5d-2bc1d2311348 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Updated VIF entry in instance network info cache for port 83696a27-5180-489d-979c-adf769267f90. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:26:10 user nova-compute[74587]: DEBUG nova.network.neutron [req-9e96b1e5-b052-4b5f-83f2-a406f67a487e req-fbff94a2-79a7-4347-8f5d-2bc1d2311348 service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Updating instance_info_cache with network_info: [{"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:26:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9e96b1e5-b052-4b5f-83f2-a406f67a487e req-fbff94a2-79a7-4347-8f5d-2bc1d2311348 service nova] Releasing lock "refresh_cache-92ab75dd-21c4-4067-9e9a-6a86861bcfea" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:11 user nova-compute[74587]: INFO nova.compute.manager [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Terminating instance
Oct 18 07:26:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-c17ad446-51a7-41d6-a3d7-045fa064a088 req-f6da4675-6f62-4d60-b68a-bc2069f5e3ce service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received event network-vif-unplugged-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c17ad446-51a7-41d6-a3d7-045fa064a088 req-f6da4675-6f62-4d60-b68a-bc2069f5e3ce service nova] Acquiring lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c17ad446-51a7-41d6-a3d7-045fa064a088 req-f6da4675-6f62-4d60-b68a-bc2069f5e3ce service nova] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c17ad446-51a7-41d6-a3d7-045fa064a088 req-f6da4675-6f62-4d60-b68a-bc2069f5e3ce service nova] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-c17ad446-51a7-41d6-a3d7-045fa064a088 req-f6da4675-6f62-4d60-b68a-bc2069f5e3ce service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] No waiting events found dispatching network-vif-unplugged-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-c17ad446-51a7-41d6-a3d7-045fa064a088 req-f6da4675-6f62-4d60-b68a-bc2069f5e3ce service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received event network-vif-unplugged-83696a27-5180-489d-979c-adf769267f90 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Instance destroyed successfully.
Oct 18 07:26:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lazy-loading 'resources' on Instance uuid 92ab75dd-21c4-4067-9e9a-6a86861bcfea {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1646355358',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1646355358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1646355358',id=29,image_ref='ec73159d-30ef-4a07-abeb-61ed19b29335',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoZdfhIF0Y93q4Mac7SIDDJXsqoklQdIbIllnmWfUXQKr525UrGU9Gvq2MC7PFNg05uhN76zDyWeq6MHmzzxsADFhmyl1j3KfvgKzhK/7/iri59ne4J7pSfa9+1RF3fAQ==',key_name='tempest-keypair-1306027815',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:24:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-r2gcdplb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1301266373',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:24:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=92ab75dd-21c4-4067-9e9a-6a86861bcfea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "83696a27-5180-489d-979c-adf769267f90", "address": "fa:16:3e:5a:67:a1", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83696a27-51", "ovs_interfaceid": "83696a27-5180-489d-979c-adf769267f90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:67:a1,bridge_name='br-int',has_traffic_filtering=True,id=83696a27-5180-489d-979c-adf769267f90,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83696a27-51') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_vif [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:67:a1,bridge_name='br-int',has_traffic_filtering=True,id=83696a27-5180-489d-979c-adf769267f90,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83696a27-51') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83696a27-51, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cfde798-6953-4d2d-a1eb-d9ecca146009) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:12 user nova-compute[74587]: INFO os_vif [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:67:a1,bridge_name='br-int',has_traffic_filtering=True,id=83696a27-5180-489d-979c-adf769267f90,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83696a27-51')
Oct 18 07:26:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGetmSYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:26:12 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff87a57-2f89-4ebc-b3b6-b753d45ac361]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:26:12 user nova-compute[74587]: No targets found.
Oct 18 07:26:12 user nova-compute[74587]: iSNS:
Oct 18 07:26:12 user nova-compute[74587]: No targets found.
Oct 18 07:26:12 user nova-compute[74587]: STATIC:
Oct 18 07:26:12 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da
Oct 18 07:26:12 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:26:12 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:26:12 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920
Oct 18 07:26:12 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:26:12 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:26:12 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:26:12 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:26:12 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:26:12 user nova-compute[74587]: FIRMWARE:
Oct 18 07:26:12 user nova-compute[74587]: No targets found.
Oct 18 07:26:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:26:12 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:26:12 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8be45c5-7a09-4578-92bd-b1eb0d5f5d92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[47635cb9-8863-4d38-83cd-90da33943a4c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:12 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:12 user nova-compute[74587]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)
Oct 18 07:26:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:12 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:12 user nova-compute[74587]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 (non-flash)
Oct 18 07:26:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4505510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920'): ({'sde'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Removing single pathed devices sde {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b711379-da28-406d-b44d-ddecb28c952c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f975e62b-773d-45d2-be07-251453aad959]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flushing IO for device /dev/sde {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c8645c-662c-46cf-bb05-eb78165c2855]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8831ca9-f1e4-45c9-86e0-1ecf020666a1]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26634346436663739', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_88aca4aa') {{(pid=85802) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 18 07:26:12 user nova-compute[74587]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26634346436663739
Oct 18 07:26:12 user nova-compute[74587]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_88aca4aa
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6019d836-fa9c-4f10-b0a6-e071f291d436]: (4, None) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6374fc0-fce4-4696-b325-885eb494ab49]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[692994e0-30c7-4bcc-a851-7870a6a1bcf3]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920, portal: 172.16.0.220,3260]
Oct 18 07:26:12 user nova-compute[74587]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920, portal: 172.16.0.220,3260] successful.
Oct 18 07:26:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd9b926b-1eb1-4a27-ae88-699789649920 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[66af27c6-35e6-47d9-a49f-d8de09d9af1a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== disconnect_volume: return (404ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:26:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Deleting instance files /opt/stack/data/nova/instances/92ab75dd-21c4-4067-9e9a-6a86861bcfea_del
Oct 18 07:26:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Deletion of /opt/stack/data/nova/instances/92ab75dd-21c4-4067-9e9a-6a86861bcfea_del complete
Oct 18 07:26:12 user nova-compute[74587]: INFO nova.compute.manager [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Took 1.42 seconds to destroy the instance on the hypervisor.
Oct 18 07:26:12 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:26:12 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:26:13 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:26:13 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Took 0.74 seconds to deallocate network for instance.
Oct 18 07:26:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ba3c6ef-1801-4940-99f6-c99a07289ab5 req-ce932dd6-d4b6-4b0a-9ba1-f1f2bd5cc19b service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received event network-vif-plugged-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ba3c6ef-1801-4940-99f6-c99a07289ab5 req-ce932dd6-d4b6-4b0a-9ba1-f1f2bd5cc19b service nova] Acquiring lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ba3c6ef-1801-4940-99f6-c99a07289ab5 req-ce932dd6-d4b6-4b0a-9ba1-f1f2bd5cc19b service nova] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ba3c6ef-1801-4940-99f6-c99a07289ab5 req-ce932dd6-d4b6-4b0a-9ba1-f1f2bd5cc19b service nova] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ba3c6ef-1801-4940-99f6-c99a07289ab5 req-ce932dd6-d4b6-4b0a-9ba1-f1f2bd5cc19b service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] No waiting events found dispatching network-vif-plugged-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:13 user nova-compute[74587]: WARNING nova.compute.manager [req-7ba3c6ef-1801-4940-99f6-c99a07289ab5 req-ce932dd6-d4b6-4b0a-9ba1-f1f2bd5cc19b service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received unexpected event network-vif-plugged-83696a27-5180-489d-979c-adf769267f90 for instance with vm_state active and task_state deleting.
Oct 18 07:26:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ba3c6ef-1801-4940-99f6-c99a07289ab5 req-ce932dd6-d4b6-4b0a-9ba1-f1f2bd5cc19b service nova] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Received event network-vif-deleted-83696a27-5180-489d-979c-adf769267f90 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-8d44cc83-fcb8-4408-a481-05041eeed2f2 req-801ce882-9c0f-400f-b7f7-147711e37180 service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received event network-changed-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-8d44cc83-fcb8-4408-a481-05041eeed2f2 req-801ce882-9c0f-400f-b7f7-147711e37180 service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Refreshing instance network info cache due to event network-changed-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:26:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8d44cc83-fcb8-4408-a481-05041eeed2f2 req-801ce882-9c0f-400f-b7f7-147711e37180 service nova] Acquiring lock "refresh_cache-d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:26:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8d44cc83-fcb8-4408-a481-05041eeed2f2 req-801ce882-9c0f-400f-b7f7-147711e37180 service nova] Acquired lock "refresh_cache-d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:26:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-8d44cc83-fcb8-4408-a481-05041eeed2f2 req-801ce882-9c0f-400f-b7f7-147711e37180 service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Refreshing network info cache for port d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:26:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-8d44cc83-fcb8-4408-a481-05041eeed2f2 req-801ce882-9c0f-400f-b7f7-147711e37180 service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Updated VIF entry in instance network info cache for port d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:26:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-8d44cc83-fcb8-4408-a481-05041eeed2f2 req-801ce882-9c0f-400f-b7f7-147711e37180 service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Updating instance_info_cache with network_info: [{"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:26:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8d44cc83-fcb8-4408-a481-05041eeed2f2 req-801ce882-9c0f-400f-b7f7-147711e37180 service nova] Releasing lock "refresh_cache-d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:26:15 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:26:15 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:16 user nova-compute[74587]: INFO nova.compute.manager [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Terminating instance
Oct 18 07:26:16 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-27787d03-faf3-452c-8903-f78d6a46063b req-9206cb0c-a933-45c3-85f4-a2e5cabea976 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-vif-unplugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-27787d03-faf3-452c-8903-f78d6a46063b req-9206cb0c-a933-45c3-85f4-a2e5cabea976 service nova] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-27787d03-faf3-452c-8903-f78d6a46063b req-9206cb0c-a933-45c3-85f4-a2e5cabea976 service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-27787d03-faf3-452c-8903-f78d6a46063b req-9206cb0c-a933-45c3-85f4-a2e5cabea976 service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-27787d03-faf3-452c-8903-f78d6a46063b req-9206cb0c-a933-45c3-85f4-a2e5cabea976 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] No waiting events found dispatching network-vif-unplugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-27787d03-faf3-452c-8903-f78d6a46063b req-9206cb0c-a933-45c3-85f4-a2e5cabea976 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-vif-unplugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:17 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Instance destroyed successfully.
Oct 18 07:26:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lazy-loading 'resources' on Instance uuid db21a40f-ceef-4c74-949f-80b83c82f1e5 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1244513542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1244513542',id=25,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy2/cWP8WQ1La5/QKuL3jYChPeN0VPAAZ3nrF6uVf9b1QBGYXd0EDBi2DmgRL39gFo910hg16O6gyhq3Su5lGILbUf2jiLTF5VIlvuS+se1aJqzZiOC2YYW1GdUWIn5/w==',key_name='tempest-keypair-1932888942',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:24:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35bbc4b5dcf34f2a8eedb939389e7234',ramdisk_id='',reservation_id='r-y1fpij3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1000148669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1000148669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af9278b67f224f1695c90223a4dc1181',uuid=db21a40f-ceef-4c74-949f-80b83c82f1e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converting VIF {"id": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "address": "fa:16:3e:b9:ef:f7", "network": {"id": "35e6b2ad-eb54-4a9e-8f15-064b90d6cf27", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1138373599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35bbc4b5dcf34f2a8eedb939389e7234", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0a10ff-6f", "ovs_interfaceid": "6b0a10ff-6fe0-4564-b1ea-29cc81f01924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG os_vif [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b0a10ff-6f, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad0d15e0-c6d2-4f1c-952c-651ad1456afc) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:26:17 user nova-compute[74587]: INFO os_vif [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ef:f7,bridge_name='br-int',has_traffic_filtering=True,id=6b0a10ff-6fe0-4564-b1ea-29cc81f01924,network=Network(35e6b2ad-eb54-4a9e-8f15-064b90d6cf27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0a10ff-6f')
Oct 18 07:26:17 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Deleting instance files /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5_del
Oct 18 07:26:17 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Deletion of /opt/stack/data/nova/instances/db21a40f-ceef-4c74-949f-80b83c82f1e5_del complete
Oct 18 07:26:17 user nova-compute[74587]: INFO nova.compute.manager [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 18 07:26:17 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:26:17 user nova-compute[74587]: INFO nova.compute.manager [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Took 4.29 seconds to detach 1 volumes for instance.
Oct 18 07:26:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 92ab75dd-21c4-4067-9e9a-6a86861bcfea] Deleting volume: fd9b926b-1eb1-4a27-ae88-699789649920 {{(pid=74587) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:18 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:26:18 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:26:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:18 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Deleted allocations for instance 92ab75dd-21c4-4067-9e9a-6a86861bcfea
Oct 18 07:26:18 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:26:18 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Took 0.76 seconds to deallocate network for instance.
Oct 18 07:26:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4f3dca5e-292a-4ace-9328-e57e614aba80 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "92ab75dd-21c4-4067-9e9a-6a86861bcfea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.152s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:26:18 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:26:18 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:26:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:18 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Deleted allocations for instance db21a40f-ceef-4c74-949f-80b83c82f1e5
Oct 18 07:26:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ad27257a-416a-487c-b78e-535be810ac2e tempest-AttachVolumeShelveTestJSON-1000148669 tempest-AttachVolumeShelveTestJSON-1000148669-project-member] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-1c43ba15-43c7-4a2e-af74-a4049cddbba6 req-95b002fd-e515-4cfb-a97f-0b794b418055 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1c43ba15-43c7-4a2e-af74-a4049cddbba6 req-95b002fd-e515-4cfb-a97f-0b794b418055 service nova] Acquiring lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1c43ba15-43c7-4a2e-af74-a4049cddbba6 req-95b002fd-e515-4cfb-a97f-0b794b418055 service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1c43ba15-43c7-4a2e-af74-a4049cddbba6 req-95b002fd-e515-4cfb-a97f-0b794b418055 service nova] Lock "db21a40f-ceef-4c74-949f-80b83c82f1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-1c43ba15-43c7-4a2e-af74-a4049cddbba6 req-95b002fd-e515-4cfb-a97f-0b794b418055 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] No waiting events found dispatching network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:19 user nova-compute[74587]: WARNING nova.compute.manager [req-1c43ba15-43c7-4a2e-af74-a4049cddbba6 req-95b002fd-e515-4cfb-a97f-0b794b418055 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received unexpected event network-vif-plugged-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 for instance with vm_state deleted and task_state None.
Oct 18 07:26:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-1c43ba15-43c7-4a2e-af74-a4049cddbba6 req-95b002fd-e515-4cfb-a97f-0b794b418055 service nova] [instance: db21a40f-ceef-4c74-949f-80b83c82f1e5] Received event network-vif-deleted-6b0a10ff-6fe0-4564-b1ea-29cc81f01924 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG nova.objects.instance [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'flavor' on Instance uuid d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "bb153556-57ca-4401-894a-e3588a05e460" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:21 user nova-compute[74587]: INFO nova.compute.manager [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Attaching volume 1e0ed6c3-a76c-4651-96ee-42075853c28a to /dev/vdb
Oct 18 07:26:21 user nova-compute[74587]: DEBUG os_brick.utils [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:26:21 user nova-compute[74587]: INFO nova.compute.claims [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Claim successful on node user
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5136f8-91e4-4d23-894d-40e92928bfa4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdecc572-f33a-4dc0-94bd-365a170cf11a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcafba3-bcfc-41cc-9a6c-52e40d5c0ba3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f627848-c7e9-4ff2-9ced-4f16504cf347]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:26:21 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:26:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe0d6cd-d11f-48f3-b03b-f86be45a0f13]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG os_brick.utils [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Updating existing volume attachment record: 6131b17d-e1df-4520-bdd6-4fcdbc38358a {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:26:21 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:26:22 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:26:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:22 user nova-compute[74587]: INFO nova.virt.block_device [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Booting with volume 3d811b23-c02f-433f-99ea-ea4bd3426039 at /dev/vda
Oct 18 07:26:22 user nova-compute[74587]: DEBUG nova.policy [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b1730cd79c54e748232c046b4d3e412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196ea516329b4e479bd8f54644007c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG os_brick.utils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b13206-98b1-44fc-b0c3-403cb180421f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a648d3c-d3ca-4b33-8858-e5c7fcd8b938]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5b6fdb-2ceb-44eb-bde4-82e0db8f5c92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65a6c41-9e7b-4bb7-986a-858d14a55892]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:26:22 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:26:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb43bd68-5bf9-4fea-be48-1d74d3c2a098]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG os_brick.utils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating existing volume attachment record: fba79e88-f4d5-42a0-9cf2-ad2060fe20d2 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:26:22 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Successfully created port: e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Successfully updated port: e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquired lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-0794a1f3-7b6f-4656-b8c0-3ee5b1e19515 req-dee9b090-c2a8-4f01-87f7-44d1a11d9799 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-changed-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-0794a1f3-7b6f-4656-b8c0-3ee5b1e19515 req-dee9b090-c2a8-4f01-87f7-44d1a11d9799 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Refreshing instance network info cache due to event network-changed-e6c2a831-ec15-4209-82ee-ebfdea1813fa. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0794a1f3-7b6f-4656-b8c0-3ee5b1e19515 req-dee9b090-c2a8-4f01-87f7-44d1a11d9799 service nova] Acquiring lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating instance_info_cache with network_info: [{"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Releasing lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Instance network_info: |[{"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0794a1f3-7b6f-4656-b8c0-3ee5b1e19515 req-dee9b090-c2a8-4f01-87f7-44d1a11d9799 service nova] Acquired lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:26:23 user nova-compute[74587]: DEBUG nova.network.neutron [req-0794a1f3-7b6f-4656-b8c0-3ee5b1e19515 req-dee9b090-c2a8-4f01-87f7-44d1a11d9799 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Refreshing network info cache for port e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:26:24 user nova-compute[74587]: DEBUG nova.network.neutron [req-0794a1f3-7b6f-4656-b8c0-3ee5b1e19515 req-dee9b090-c2a8-4f01-87f7-44d1a11d9799 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updated VIF entry in instance network info cache for port e6c2a831-ec15-4209-82ee-ebfdea1813fa. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:26:24 user nova-compute[74587]: DEBUG nova.network.neutron [req-0794a1f3-7b6f-4656-b8c0-3ee5b1e19515 req-dee9b090-c2a8-4f01-87f7-44d1a11d9799 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating instance_info_cache with network_info: [{"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:26:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0794a1f3-7b6f-4656-b8c0-3ee5b1e19515 req-dee9b090-c2a8-4f01-87f7-44d1a11d9799 service nova] Releasing lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:26:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: bb153556-57ca-4401-894a-e3588a05e460] Skipping network cache update for instance because it is Building. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 12b4c420-79fd-4f58-a422-59dc2b89731f {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updating instance_info_cache with network_info: [{"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-12b4c420-79fd-4f58-a422-59dc2b89731f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:25 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:28 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:26:28 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8096MB free_disk=25.184810638427734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d9651223-0963-4247-ab2b-48f42efb1dc8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance af696b6e-6fc7-44ee-a514-c49f6f6b340a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 665a2f6d-4704-400e-aeca-ae8cb29333da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance bf09a68d-be43-42a5-a1d3-376714e16770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance bb153556-57ca-4401-894a-e3588a05e460 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:26:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:26:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:26:39 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Creating image(s)
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Ensure instance console log exists: /opt/stack/data/nova/instances/bb153556-57ca-4401-894a-e3588a05e460/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Start _get_guest_xml network_info=[{"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fba79e88-f4d5-42a0-9cf2-ad2060fe20d2', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glFnWiTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb153556-57ca-4401-894a-e3588a05e460', 'attached_at': '', 'detached_at': '', 'volume_id': '3d811b23-c02f-433f-99ea-ea4bd3426039', 'serial': '3d811b23-c02f-433f-99ea-ea4bd3426039'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:26:39 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:26:39 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glFnWiTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:26:39 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:26:39 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:26:39 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b6f44c-067a-4a89-a0c7-415b1b21cb06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:26:39 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4adf61-4f05-420b-b988-0316f1de9343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039] added
Oct 18 07:26:39 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e828ae7c-6a8a-45f2-93ee-b0a3e2cb225a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c98e4c-c225-4383-81e5-f4131212e365]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glFnWiTN {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glFnWiTN" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af2474c-46ce-4ae0-ac31-23e8046ed7c6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'glFnWiTN'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4213f0be-beca-46df-abe5-ca6ebb5c2815]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b544b5-018d-41a8-b2c5-a35b9ffe5f9a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:39 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:39 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:39 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:39 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:26:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca07aa1c-f9a2-455c-a590-31cbbf99edee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260]
Oct 18 07:26:40 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260] successful.
Oct 18 07:26:40 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c159079c-e644-48c1-ab7d-09fbaf993a28]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[71376abf-6dd9-4cc7-80a2-dc2539fafe33]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:40 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:40 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:26:40 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:40 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:40 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:26:40 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d1a7a1-0919-4e07-baa3-ee959bcec149]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:40 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glFnWiTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23737656335393539', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737656335393539', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1974074510',display_name='tempest-ServerActionsTestOtherA-server-1974074510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1974074510',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA52QLTWvy/v2jV8SnvcFET/QtPPTqG94sHIUJ+eIA4fj3Aw4bOkxeUXjNyfaIA0FLk6wcOPrhSmuqIwPWgig8KHxvH3mp04gQBlQsoVn3vpHBaDRDx2a25MshLKHMkpQ==',key_name='tempest-keypair-952803272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-9tmk55cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:26:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=bb153556-57ca-4401-894a-e3588a05e460,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'pci_devices' on Instance uuid bb153556-57ca-4401-894a-e3588a05e460 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:26:41 user nova-compute[74587]:   <uuid>bb153556-57ca-4401-894a-e3588a05e460</uuid>
Oct 18 07:26:41 user nova-compute[74587]:   <name>instance-00000020</name>
Oct 18 07:26:41 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:26:41 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:26:41 user nova-compute[74587]:   <metadata>
Oct 18 07:26:41 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:26:41 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:26:41 user nova-compute[74587]:       <nova:name>tempest-ServerActionsTestOtherA-server-1974074510</nova:name>
Oct 18 07:26:41 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:26:39</nova:creationTime>
Oct 18 07:26:41 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:26:41 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:26:41 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:26:41 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:26:41 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:26:41 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:26:41 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:26:41 user nova-compute[74587]:       <nova:owner>
Oct 18 07:26:41 user nova-compute[74587]:         <nova:user uuid="1b1730cd79c54e748232c046b4d3e412">tempest-ServerActionsTestOtherA-2039083727-project-member</nova:user>
Oct 18 07:26:41 user nova-compute[74587]:         <nova:project uuid="196ea516329b4e479bd8f54644007c57">tempest-ServerActionsTestOtherA-2039083727</nova:project>
Oct 18 07:26:41 user nova-compute[74587]:       </nova:owner>
Oct 18 07:26:41 user nova-compute[74587]:       <nova:ports>
Oct 18 07:26:41 user nova-compute[74587]:         <nova:port uuid="e6c2a831-ec15-4209-82ee-ebfdea1813fa">
Oct 18 07:26:41 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 07:26:41 user nova-compute[74587]:         </nova:port>
Oct 18 07:26:41 user nova-compute[74587]:       </nova:ports>
Oct 18 07:26:41 user nova-compute[74587]:     </nova:instance>
Oct 18 07:26:41 user nova-compute[74587]:   </metadata>
Oct 18 07:26:41 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:26:41 user nova-compute[74587]:     <system>
Oct 18 07:26:41 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:26:41 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:26:41 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:26:41 user nova-compute[74587]:       <entry name="serial">bb153556-57ca-4401-894a-e3588a05e460</entry>
Oct 18 07:26:41 user nova-compute[74587]:       <entry name="uuid">bb153556-57ca-4401-894a-e3588a05e460</entry>
Oct 18 07:26:41 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:26:41 user nova-compute[74587]:     </system>
Oct 18 07:26:41 user nova-compute[74587]:   </sysinfo>
Oct 18 07:26:41 user nova-compute[74587]:   <os>
Oct 18 07:26:41 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:26:41 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:26:41 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:26:41 user nova-compute[74587]:   </os>
Oct 18 07:26:41 user nova-compute[74587]:   <features>
Oct 18 07:26:41 user nova-compute[74587]:     <acpi/>
Oct 18 07:26:41 user nova-compute[74587]:     <apic/>
Oct 18 07:26:41 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:26:41 user nova-compute[74587]:   </features>
Oct 18 07:26:41 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:26:41 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:26:41 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:26:41 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:26:41 user nova-compute[74587]:   </clock>
Oct 18 07:26:41 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:26:41 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:26:41 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:26:41 user nova-compute[74587]:   </cpu>
Oct 18 07:26:41 user nova-compute[74587]:   <devices>
Oct 18 07:26:41 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:26:41 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:26:41 user nova-compute[74587]:       <source dev="/dev/sdb"/>
Oct 18 07:26:41 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:26:41 user nova-compute[74587]:       <serial>3d811b23-c02f-433f-99ea-ea4bd3426039</serial>
Oct 18 07:26:41 user nova-compute[74587]:     </disk>
Oct 18 07:26:41 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:26:41 user nova-compute[74587]:       <mac address="fa:16:3e:68:56:dd"/>
Oct 18 07:26:41 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:26:41 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:26:41 user nova-compute[74587]:       <target dev="tape6c2a831-ec"/>
Oct 18 07:26:41 user nova-compute[74587]:     </interface>
Oct 18 07:26:41 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:26:41 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/bb153556-57ca-4401-894a-e3588a05e460/console.log" append="off"/>
Oct 18 07:26:41 user nova-compute[74587]:     </serial>
Oct 18 07:26:41 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:26:41 user nova-compute[74587]:     <video>
Oct 18 07:26:41 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:26:41 user nova-compute[74587]:     </video>
Oct 18 07:26:41 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:26:41 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:26:41 user nova-compute[74587]:     </rng>
Oct 18 07:26:41 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:26:41 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:26:41 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:26:41 user nova-compute[74587]:     </memballoon>
Oct 18 07:26:41 user nova-compute[74587]:   </devices>
Oct 18 07:26:41 user nova-compute[74587]: </domain>
Oct 18 07:26:41 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1974074510',display_name='tempest-ServerActionsTestOtherA-server-1974074510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1974074510',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA52QLTWvy/v2jV8SnvcFET/QtPPTqG94sHIUJ+eIA4fj3Aw4bOkxeUXjNyfaIA0FLk6wcOPrhSmuqIwPWgig8KHxvH3mp04gQBlQsoVn3vpHBaDRDx2a25MshLKHMkpQ==',key_name='tempest-keypair-952803272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-9tmk55cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:26:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=bb153556-57ca-4401-894a-e3588a05e460,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG os_vif [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4ad5865-f1b0-59d3-9cf6-62b145aed8a5', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6c2a831-ec, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6c2a831-ec, col_values=(('qos', UUID('af8cf80f-8023-42e0-b812-76d1fcc2ae38')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6c2a831-ec, col_values=(('external_ids', {'iface-id': 'e6c2a831-ec15-4209-82ee-ebfdea1813fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:56:dd', 'vm-uuid': 'bb153556-57ca-4401-894a-e3588a05e460'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:41 user nova-compute[74587]: INFO os_vif [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec')
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:26:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No VIF found with MAC fa:16:3e:68:56:dd, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:26:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-325248d5-d2e7-42f3-848a-ef6094e838c9 req-af89c03e-4641-4f63-bae7-2489fd2e3bed service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-325248d5-d2e7-42f3-848a-ef6094e838c9 req-af89c03e-4641-4f63-bae7-2489fd2e3bed service nova] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-325248d5-d2e7-42f3-848a-ef6094e838c9 req-af89c03e-4641-4f63-bae7-2489fd2e3bed service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-325248d5-d2e7-42f3-848a-ef6094e838c9 req-af89c03e-4641-4f63-bae7-2489fd2e3bed service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-325248d5-d2e7-42f3-848a-ef6094e838c9 req-af89c03e-4641-4f63-bae7-2489fd2e3bed service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] No waiting events found dispatching network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:42 user nova-compute[74587]: WARNING nova.compute.manager [req-325248d5-d2e7-42f3-848a-ef6094e838c9 req-af89c03e-4641-4f63-bae7-2489fd2e3bed service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received unexpected event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa for instance with vm_state building and task_state spawning.
Oct 18 07:26:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:26:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:26:44 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: bb153556-57ca-4401-894a-e3588a05e460] Instance spawned successfully.
Oct 18 07:26:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:26:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:26:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:26:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:26:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:26:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:26:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:26:44 user nova-compute[74587]: INFO nova.compute.manager [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Took 5.21 seconds to spawn the instance on the hypervisor.
Oct 18 07:26:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:26:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-faeb10f2-5881-49ac-9fc3-c1a2e4687446 req-18593471-5b49-49b5-8550-33c836580720 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-faeb10f2-5881-49ac-9fc3-c1a2e4687446 req-18593471-5b49-49b5-8550-33c836580720 service nova] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-faeb10f2-5881-49ac-9fc3-c1a2e4687446 req-18593471-5b49-49b5-8550-33c836580720 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-faeb10f2-5881-49ac-9fc3-c1a2e4687446 req-18593471-5b49-49b5-8550-33c836580720 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-faeb10f2-5881-49ac-9fc3-c1a2e4687446 req-18593471-5b49-49b5-8550-33c836580720 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] No waiting events found dispatching network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:45 user nova-compute[74587]: WARNING nova.compute.manager [req-faeb10f2-5881-49ac-9fc3-c1a2e4687446 req-18593471-5b49-49b5-8550-33c836580720 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received unexpected event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa for instance with vm_state building and task_state spawning.
Oct 18 07:26:45 user nova-compute[74587]: INFO nova.compute.manager [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Took 23.55 seconds to build instance.
Oct 18 07:26:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e16fc24f-c615-474b-86d9-846061fbfed7 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "bb153556-57ca-4401-894a-e3588a05e460" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.655s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUFTgCQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:26:46 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:26:46 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:26:46 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf52e54-b417-42ef-872c-06ef740937da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:26:46 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c957f8fb-74ec-4c3f-b887-2276a323d962]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a] added
Oct 18 07:26:46 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a9a45-72de-4128-8212-b4401a31c46a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a274d6-777e-469f-86ed-a8a1134350ce]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OUFTgCQN {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OUFTgCQN" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f696afc3-e502-4b86-b474-8ca4b89f1456]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OUFTgCQN'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e17272c-abf5-4a78-8730-63e995493cab]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e019fe-01a3-49a7-aecb-b66c335a67d9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:46 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:46 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:26:46 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:46 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:46 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:26:46 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:26:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5862f15e-331d-41d6-aa78-e1bef869eedf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a, portal: 172.16.0.220,3260]
Oct 18 07:26:47 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a, portal: 172.16.0.220,3260] successful.
Oct 18 07:26:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd937b60-9833-4f42-ae88-bca30ca7c69d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee4b20d-480a-466f-aead-0c05e475679c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:47 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:47 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:26:47 user nova-compute[74587]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a (non-flash)
Oct 18 07:26:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:47 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:47 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:26:47 user nova-compute[74587]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a (non-flash)
Oct 18 07:26:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[707836ef-5ab6-43ef-b2d3-659af6d265fd]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUFTgCQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:26:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:26:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26430643234326533', 'path': '/dev/sde'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:26:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430643234326533', 'path': '/dev/sde'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:26:48 user nova-compute[74587]: DEBUG nova.objects.instance [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'flavor' on Instance uuid d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:26:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:26:48 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:26:48 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:26:48 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:26:48 user nova-compute[74587]:   <serial>1e0ed6c3-a76c-4651-96ee-42075853c28a</serial>
Oct 18 07:26:48 user nova-compute[74587]: </disk>
Oct 18 07:26:48 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:26:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:26:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:26:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No VIF found with MAC fa:16:3e:ad:29:f0, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:26:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ac1b53a8-f3ec-487f-9239-97c323ecd7b6 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.332s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:49 user nova-compute[74587]: INFO nova.compute.manager [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Terminating instance
Oct 18 07:26:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-37e94e3c-800b-4df7-a460-5a41092810ea req-93ed736f-b0b6-4a65-82c1-714ee6186b87 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-unplugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-37e94e3c-800b-4df7-a460-5a41092810ea req-93ed736f-b0b6-4a65-82c1-714ee6186b87 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-37e94e3c-800b-4df7-a460-5a41092810ea req-93ed736f-b0b6-4a65-82c1-714ee6186b87 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-37e94e3c-800b-4df7-a460-5a41092810ea req-93ed736f-b0b6-4a65-82c1-714ee6186b87 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-37e94e3c-800b-4df7-a460-5a41092810ea req-93ed736f-b0b6-4a65-82c1-714ee6186b87 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-unplugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-37e94e3c-800b-4df7-a460-5a41092810ea req-93ed736f-b0b6-4a65-82c1-714ee6186b87 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-unplugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:49 user nova-compute[74587]: INFO nova.compute.manager [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Detaching volume 1e0ed6c3-a76c-4651-96ee-42075853c28a
Oct 18 07:26:50 user nova-compute[74587]: INFO nova.virt.block_device [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Attempting to driver detach volume 1e0ed6c3-a76c-4651-96ee-42075853c28a from mountpoint /dev/vdb
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Attempting to detach device vdb from instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:26:50 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:26:50 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:26:50 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:26:50 user nova-compute[74587]:   <serial>1e0ed6c3-a76c-4651-96ee-42075853c28a</serial>
Oct 18 07:26:50 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:26:50 user nova-compute[74587]: </disk>
Oct 18 07:26:50 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:26:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully detached device vdb from instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db from the persistent domain config.
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:26:50 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:26:50 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:26:50 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:26:50 user nova-compute[74587]:   <serial>1e0ed6c3-a76c-4651-96ee-42075853c28a</serial>
Oct 18 07:26:50 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:26:50 user nova-compute[74587]: </disk>
Oct 18 07:26:50 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "bf09a68d-be43-42a5-a1d3-376714e16770" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "bf09a68d-be43-42a5-a1d3-376714e16770" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:50 user nova-compute[74587]: INFO nova.compute.manager [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Terminating instance
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:26:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Instance destroyed successfully.
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.objects.instance [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'resources' on Instance uuid d9651223-0963-4247-ab2b-48f42efb1dc8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1798708892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1798708892',id=12,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:12:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-604sfei6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:14:48Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=d9651223-0963-4247-ab2b-48f42efb1dc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "6776f41a-346e-45fa-a618-bc4f28583854", "address": "fa:16:3e:7f:e2:2a", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6776f41a-34", "ovs_interfaceid": "6776f41a-346e-45fa-a618-bc4f28583854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=6776f41a-346e-45fa-a618-bc4f28583854,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6776f41a-34') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_vif [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=6776f41a-346e-45fa-a618-bc4f28583854,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6776f41a-34') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6776f41a-34, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04334aba-d785-43ce-9461-91e23a332fd9) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:50 user nova-compute[74587]: INFO os_vif [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=6776f41a-346e-45fa-a618-bc4f28583854,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6776f41a-34')
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVTGlAzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:26:50 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[856f7086-7944-4570-9acf-5a7732b0621b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:26:50 user nova-compute[74587]: No targets found.
Oct 18 07:26:50 user nova-compute[74587]: iSNS:
Oct 18 07:26:50 user nova-compute[74587]: No targets found.
Oct 18 07:26:50 user nova-compute[74587]: STATIC:
Oct 18 07:26:50 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a
Oct 18 07:26:50 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:26:50 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:26:50 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da
Oct 18 07:26:50 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:26:50 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:26:50 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039
Oct 18 07:26:50 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:26:50 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:26:50 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef
Oct 18 07:26:50 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:26:50 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:26:50 user nova-compute[74587]: FIRMWARE:
Oct 18 07:26:50 user nova-compute[74587]: No targets found.
Oct 18 07:26:50 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:26:50 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:26:50 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fb1915-b752-42e3-ba1e-b82d5b69901b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-0fc77426-5057-42e7-9edf-44bdb0e3ba97 req-63187639-8a33-4c15-ad56-90770a246fbf service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Received event network-vif-unplugged-206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0fc77426-5057-42e7-9edf-44bdb0e3ba97 req-63187639-8a33-4c15-ad56-90770a246fbf service nova] Acquiring lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0fc77426-5057-42e7-9edf-44bdb0e3ba97 req-63187639-8a33-4c15-ad56-90770a246fbf service nova] Lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0fc77426-5057-42e7-9edf-44bdb0e3ba97 req-63187639-8a33-4c15-ad56-90770a246fbf service nova] Lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-0fc77426-5057-42e7-9edf-44bdb0e3ba97 req-63187639-8a33-4c15-ad56-90770a246fbf service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] No waiting events found dispatching network-vif-unplugged-206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-0fc77426-5057-42e7-9edf-44bdb0e3ba97 req-63187639-8a33-4c15-ad56-90770a246fbf service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Received event network-vif-unplugged-206b0110-99cd-4cd6-b357-5c777d9149de for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eed145d-9266-4d0c-a805-28edd23816f5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:50 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:50 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:26:50 user nova-compute[74587]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a (non-flash)
Oct 18 07:26:50 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef (non-flash)
Oct 18 07:26:50 user nova-compute[74587]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:26:50 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:26:50 user nova-compute[74587]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a (non-flash)
Oct 18 07:26:50 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1008454ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef'): ({'sdc'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Removing single pathed devices sdc {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50cc8fc-a657-46fe-89c4-d8c25ffed777]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebae2344-a31f-4bf2-8586-6acc9677d22e]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Flushing IO for device /dev/sdc {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de326fe-0297-4545-b42d-76ed9c418e45]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12c7355-0352-4f9b-9afe-34eee7b4f8be]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.056s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3af07c-3442-4d98-8ec6-bed2c2fb33b1]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b047855a-00d6-4c88-bbf1-a4b1d2bb96a8]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef, portal: 172.16.0.220,3260]
Oct 18 07:26:51 user nova-compute[74587]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef, portal: 172.16.0.220,3260] successful.
Oct 18 07:26:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba176de3-087f-4f43-bd58-b8194b58f3ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1817c904-449f-4609-b935-88bd0c4b9790]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] <== disconnect_volume: return (388ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:26:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Deleting instance files /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8_del
Oct 18 07:26:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Deletion of /opt/stack/data/nova/instances/d9651223-0963-4247-ab2b-48f42efb1dc8_del complete
Oct 18 07:26:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Instance destroyed successfully.
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lazy-loading 'resources' on Instance uuid bf09a68d-be43-42a5-a1d3-376714e16770 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-429856399',display_name='tempest-ServersNegativeTestJSON-server-429856399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-429856399',id=31,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:25:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e52872350444fd954e9fea9743b118',ramdisk_id='',reservation_id='r-2v7vi4c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-766120743',owner_user_name='tempest-ServersNegativeTestJSON-766120743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:25:06Z,user_data=None,user_id='968bb444a9524dab94f28aa7ffab2305',uuid=bf09a68d-be43-42a5-a1d3-376714e16770,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "206b0110-99cd-4cd6-b357-5c777d9149de", "address": "fa:16:3e:de:fc:8d", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206b0110-99", "ovs_interfaceid": "206b0110-99cd-4cd6-b357-5c777d9149de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converting VIF {"id": "206b0110-99cd-4cd6-b357-5c777d9149de", "address": "fa:16:3e:de:fc:8d", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap206b0110-99", "ovs_interfaceid": "206b0110-99cd-4cd6-b357-5c777d9149de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fc:8d,bridge_name='br-int',has_traffic_filtering=True,id=206b0110-99cd-4cd6-b357-5c777d9149de,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206b0110-99') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG os_vif [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fc:8d,bridge_name='br-int',has_traffic_filtering=True,id=206b0110-99cd-4cd6-b357-5c777d9149de,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206b0110-99') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap206b0110-99, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65ed788e-057f-412d-b63a-c7e1d204a36a) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:26:51 user nova-compute[74587]: INFO os_vif [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fc:8d,bridge_name='br-int',has_traffic_filtering=True,id=206b0110-99cd-4cd6-b357-5c777d9149de,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206b0110-99')
Oct 18 07:26:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Deleting instance files /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770_del
Oct 18 07:26:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Deletion of /opt/stack/data/nova/instances/bf09a68d-be43-42a5-a1d3-376714e16770_del complete
Oct 18 07:26:51 user nova-compute[74587]: INFO nova.compute.manager [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Took 1.61 seconds to destroy the instance on the hypervisor.
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:26:51 user nova-compute[74587]: INFO nova.compute.manager [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:26:51 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Took 0.47 seconds to deallocate network for instance.
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:26:51 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Took 0.45 seconds to deallocate network for instance.
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-8af3eba4-1e63-412d-8029-1c7ee49ae387 req-df4053c1-3220-405d-a522-381f7098cd45 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8af3eba4-1e63-412d-8029-1c7ee49ae387 req-df4053c1-3220-405d-a522-381f7098cd45 service nova] Acquiring lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8af3eba4-1e63-412d-8029-1c7ee49ae387 req-df4053c1-3220-405d-a522-381f7098cd45 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8af3eba4-1e63-412d-8029-1c7ee49ae387 req-df4053c1-3220-405d-a522-381f7098cd45 service nova] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-8af3eba4-1e63-412d-8029-1c7ee49ae387 req-df4053c1-3220-405d-a522-381f7098cd45 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] No waiting events found dispatching network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:51 user nova-compute[74587]: WARNING nova.compute.manager [req-8af3eba4-1e63-412d-8029-1c7ee49ae387 req-df4053c1-3220-405d-a522-381f7098cd45 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received unexpected event network-vif-plugged-6776f41a-346e-45fa-a618-bc4f28583854 for instance with vm_state active and task_state deleting.
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-8af3eba4-1e63-412d-8029-1c7ee49ae387 req-df4053c1-3220-405d-a522-381f7098cd45 service nova] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Received event network-vif-deleted-6776f41a-346e-45fa-a618-bc4f28583854 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:26:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:52 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Deleted allocations for instance bf09a68d-be43-42a5-a1d3-376714e16770
Oct 18 07:26:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e36b0b93-c665-4cc8-9112-ab72c99ba6df tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "bf09a68d-be43-42a5-a1d3-376714e16770" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.829s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-a5fbddfe-d046-4f7c-b7cf-7e91cd46a917 req-224f3c57-3f32-4abb-89f0-16b1ef288a86 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Received event network-vif-plugged-206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a5fbddfe-d046-4f7c-b7cf-7e91cd46a917 req-224f3c57-3f32-4abb-89f0-16b1ef288a86 service nova] Acquiring lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a5fbddfe-d046-4f7c-b7cf-7e91cd46a917 req-224f3c57-3f32-4abb-89f0-16b1ef288a86 service nova] Lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a5fbddfe-d046-4f7c-b7cf-7e91cd46a917 req-224f3c57-3f32-4abb-89f0-16b1ef288a86 service nova] Lock "bf09a68d-be43-42a5-a1d3-376714e16770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-a5fbddfe-d046-4f7c-b7cf-7e91cd46a917 req-224f3c57-3f32-4abb-89f0-16b1ef288a86 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] No waiting events found dispatching network-vif-plugged-206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:26:52 user nova-compute[74587]: WARNING nova.compute.manager [req-a5fbddfe-d046-4f7c-b7cf-7e91cd46a917 req-224f3c57-3f32-4abb-89f0-16b1ef288a86 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Received unexpected event network-vif-plugged-206b0110-99cd-4cd6-b357-5c777d9149de for instance with vm_state deleted and task_state None.
Oct 18 07:26:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-a5fbddfe-d046-4f7c-b7cf-7e91cd46a917 req-224f3c57-3f32-4abb-89f0-16b1ef288a86 service nova] [instance: bf09a68d-be43-42a5-a1d3-376714e16770] Received event network-vif-deleted-206b0110-99cd-4cd6-b357-5c777d9149de {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:26:53 user nova-compute[74587]: INFO nova.compute.manager [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: d9651223-0963-4247-ab2b-48f42efb1dc8] Took 1.85 seconds to detach 1 volumes for instance.
Oct 18 07:26:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:26:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:26:53 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:26:53 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:26:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:53 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Deleted allocations for instance d9651223-0963-4247-ab2b-48f42efb1dc8
Oct 18 07:26:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-089c6ff4-6c9e-4c50-9cf4-f3cb27d79dbf tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "d9651223-0963-4247-ab2b-48f42efb1dc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.392s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:26:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:27:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:10 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db is timed out.
Oct 18 07:27:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully detached device vdb from instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db from the live domain config.
Oct 18 07:27:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUFTgCQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:27:10 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc59336e-4d9a-4b22-91ff-5f2f1648d4e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:27:10 user nova-compute[74587]: No targets found.
Oct 18 07:27:10 user nova-compute[74587]: iSNS:
Oct 18 07:27:10 user nova-compute[74587]: No targets found.
Oct 18 07:27:10 user nova-compute[74587]: STATIC:
Oct 18 07:27:10 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a
Oct 18 07:27:10 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:27:10 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:27:10 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da
Oct 18 07:27:10 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:27:10 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:27:10 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039
Oct 18 07:27:10 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:27:10 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:27:10 user nova-compute[74587]: FIRMWARE:
Oct 18 07:27:10 user nova-compute[74587]: No targets found.
Oct 18 07:27:10 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:27:10 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:27:10 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[28318e31-f84c-4f05-ba63-572c7ebb6680]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1c61f6-7f95-4e0d-bad9-987dce7207ad]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:27:10 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:27:10 user nova-compute[74587]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a (non-flash)
Oct 18 07:27:10 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:27:10 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:27:10 user nova-compute[74587]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a (non-flash)
Oct 18 07:27:10 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe43001f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a'): ({'sde'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Removing single pathed devices sde {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[155fb1b2-621f-46a1-88f5-ad38e190f683]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[17476f92-1ce0-4beb-892f-cba64b32db03]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flushing IO for device /dev/sde {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d756fe-92fa-4b81-86bb-ad8e0aa981f3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8ab500-d068-490d-8972-3fd563e932a8]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0475bc-ab7f-4b3e-a30f-aaacab6e7ad7]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c01af-9956-454a-8662-eaee8bf138d6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a, portal: 172.16.0.220,3260]
Oct 18 07:27:10 user nova-compute[74587]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a, portal: 172.16.0.220,3260] successful.
Oct 18 07:27:10 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e0ed6c3-a76c-4651-96ee-42075853c28a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[873870cc-4ac2-4f58-b333-f3fdf52a2412]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] <== disconnect_volume: return (409ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:27:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:11 user nova-compute[74587]: INFO nova.compute.manager [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Terminating instance
Oct 18 07:27:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-915ed8b3-6246-4f63-bc3e-df6ad53c5221 req-52112399-5da6-4780-8390-ef1ee7481860 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received event network-vif-unplugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-915ed8b3-6246-4f63-bc3e-df6ad53c5221 req-52112399-5da6-4780-8390-ef1ee7481860 service nova] Acquiring lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-915ed8b3-6246-4f63-bc3e-df6ad53c5221 req-52112399-5da6-4780-8390-ef1ee7481860 service nova] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-915ed8b3-6246-4f63-bc3e-df6ad53c5221 req-52112399-5da6-4780-8390-ef1ee7481860 service nova] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-915ed8b3-6246-4f63-bc3e-df6ad53c5221 req-52112399-5da6-4780-8390-ef1ee7481860 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] No waiting events found dispatching network-vif-unplugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:27:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-915ed8b3-6246-4f63-bc3e-df6ad53c5221 req-52112399-5da6-4780-8390-ef1ee7481860 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received event network-vif-unplugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:27:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Instance destroyed successfully.
Oct 18 07:27:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lazy-loading 'resources' on Instance uuid af696b6e-6fc7-44ee-a514-c49f6f6b340a {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-725973808',display_name='tempest-TestVolumeBootPattern-volume-backed-server-725973808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-725973808',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxWLJWTmIftgMAKabxgyEjLPxRbxevs/sT4nXwAuzg+ACBUBxk37r0dRG20p3t+64VeM+tUXqL/zTcL+WuTe9nFjKh+REt8GRORoZKxixPV3AShBlZzoWsjG4qxM+EblQ==',key_name='tempest-keypair-877730637',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:23:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-mhu04t50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=af696b6e-6fc7-44ee-a514-c49f6f6b340a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "address": "fa:16:3e:6d:f0:4b", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e29791-fd", "ovs_interfaceid": "84e29791-fdbb-48a2-962e-514b20c0dbe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=84e29791-fdbb-48a2-962e-514b20c0dbe9,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e29791-fd') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_vif [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=84e29791-fdbb-48a2-962e-514b20c0dbe9,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e29791-fd') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84e29791-fd, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c46384e-06a7-4395-8397-3bd7e6889bd1) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:27:12 user nova-compute[74587]: INFO os_vif [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=84e29791-fdbb-48a2-962e-514b20c0dbe9,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e29791-fd')
Oct 18 07:27:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdJkCYrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:27:12 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebca128-9037-4d90-b502-146f44c75530]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:27:12 user nova-compute[74587]: No targets found.
Oct 18 07:27:12 user nova-compute[74587]: iSNS:
Oct 18 07:27:12 user nova-compute[74587]: No targets found.
Oct 18 07:27:12 user nova-compute[74587]: STATIC:
Oct 18 07:27:12 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da
Oct 18 07:27:12 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:27:12 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:27:12 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039
Oct 18 07:27:12 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:27:12 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:27:12 user nova-compute[74587]: FIRMWARE:
Oct 18 07:27:12 user nova-compute[74587]: No targets found.
Oct 18 07:27:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:27:12 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:27:12 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7888af-15a5-49e0-8718-0f84e1f0988c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11ee0ca-00c0-4382-a2a4-3f69aee6b147]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:27:12 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:27:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da (non-flash)
Oct 18 07:27:12 user nova-compute[74587]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:27:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4505d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da'): ({'sdd'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Removing single pathed devices sdd {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8bc15a-6f4e-4bfa-9c29-0dd632b9efcd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[82668e2e-e861-492f-bcaf-8ef1ddc111b2]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flushing IO for device /dev/sdd {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e867fd-cbd7-428b-a189-980179e77446]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d41015-df5c-4311-b112-de5666771c59]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_98e7eb18', '/dev/disk/by-id/scsi-26665303165356139', '/dev/disk/by-id/scsi-1SCST_BIO98e7eb18-fe01e5a95460caca') {{(pid=85802) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 18 07:27:12 user nova-compute[74587]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_98e7eb18
Oct 18 07:27:12 user nova-compute[74587]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26665303165356139
Oct 18 07:27:12 user nova-compute[74587]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO98e7eb18-fe01e5a95460caca
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc9783-497d-4d3b-927b-d5ca5d0be700]: (4, None) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ffda7-9254-44a5-9245-f48ce0d8b3bc]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fac0c04-9e15-490c-bb24-10041b74ff0c]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da, portal: 172.16.0.220,3260]
Oct 18 07:27:12 user nova-compute[74587]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da, portal: 172.16.0.220,3260] successful.
Oct 18 07:27:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133181fc-3f6a-4380-a2a3-220f3193a3da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[af601dd8-6ec5-4f73-b51d-521ff7d9d8f3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== disconnect_volume: return (366ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:27:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Deleting instance files /opt/stack/data/nova/instances/af696b6e-6fc7-44ee-a514-c49f6f6b340a_del
Oct 18 07:27:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Deletion of /opt/stack/data/nova/instances/af696b6e-6fc7-44ee-a514-c49f6f6b340a_del complete
Oct 18 07:27:12 user nova-compute[74587]: INFO nova.compute.manager [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 18 07:27:12 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:27:12 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:27:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-bc3c0f12-c546-46b3-bdb2-4c0934732a81 req-1e0c27bd-0df8-4092-9de1-28c3873fd3cd service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received event network-vif-plugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bc3c0f12-c546-46b3-bdb2-4c0934732a81 req-1e0c27bd-0df8-4092-9de1-28c3873fd3cd service nova] Acquiring lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bc3c0f12-c546-46b3-bdb2-4c0934732a81 req-1e0c27bd-0df8-4092-9de1-28c3873fd3cd service nova] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bc3c0f12-c546-46b3-bdb2-4c0934732a81 req-1e0c27bd-0df8-4092-9de1-28c3873fd3cd service nova] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-bc3c0f12-c546-46b3-bdb2-4c0934732a81 req-1e0c27bd-0df8-4092-9de1-28c3873fd3cd service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] No waiting events found dispatching network-vif-plugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:27:13 user nova-compute[74587]: WARNING nova.compute.manager [req-bc3c0f12-c546-46b3-bdb2-4c0934732a81 req-1e0c27bd-0df8-4092-9de1-28c3873fd3cd service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received unexpected event network-vif-plugged-84e29791-fdbb-48a2-962e-514b20c0dbe9 for instance with vm_state active and task_state deleting.
Oct 18 07:27:14 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:27:14 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Took 1.43 seconds to deallocate network for instance.
Oct 18 07:27:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-9abb160f-6959-464d-b8f7-876522d3981c req-a0c9a25b-82bc-46c3-8719-fd62246aa712 service nova] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Received event network-vif-deleted-84e29791-fdbb-48a2-962e-514b20c0dbe9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:15 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:27:15 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:27:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:27:17 user nova-compute[74587]: INFO nova.compute.manager [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Took 3.46 seconds to detach 1 volumes for instance.
Oct 18 07:27:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: af696b6e-6fc7-44ee-a514-c49f6f6b340a] Deleting volume: 133181fc-3f6a-4380-a2a3-220f3193a3da {{(pid=74587) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 07:27:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:17 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:27:17 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:27:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:17 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Deleted allocations for instance af696b6e-6fc7-44ee-a514-c49f6f6b340a
Oct 18 07:27:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-39bba911-04ad-4ed5-9f1c-d8dbdd56d6c0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "af696b6e-6fc7-44ee-a514-c49f6f6b340a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.720s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:27:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:27:21 user nova-compute[74587]: DEBUG nova.objects.instance [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'flavor' on Instance uuid d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:27:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-85a8ae71-4bb1-464d-b8a9-7dbb0f0354e3 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.329s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:23 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:27:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:27:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:27:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:27:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:27:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:27:26 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:27:26 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updating instance_info_cache with network_info: [{"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:27:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:27:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:28 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:27:29 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:27:29 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8212MB free_disk=25.20052719116211GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 12b4c420-79fd-4f58-a422-59dc2b89731f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 665a2f6d-4704-400e-aeca-ae8cb29333da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance bb153556-57ca-4401-894a-e3588a05e460 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:27:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:27:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:40 user nova-compute[74587]: INFO nova.compute.manager [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Terminating instance
Oct 18 07:27:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:40 user nova-compute[74587]: INFO nova.compute.manager [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Terminating instance
Oct 18 07:27:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-bcef0354-391a-48c5-a113-8a83a90898f8 req-f0ca5ef8-cf9f-4c13-a06d-9e5d14a4648e service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-vif-unplugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcef0354-391a-48c5-a113-8a83a90898f8 req-f0ca5ef8-cf9f-4c13-a06d-9e5d14a4648e service nova] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcef0354-391a-48c5-a113-8a83a90898f8 req-f0ca5ef8-cf9f-4c13-a06d-9e5d14a4648e service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bcef0354-391a-48c5-a113-8a83a90898f8 req-f0ca5ef8-cf9f-4c13-a06d-9e5d14a4648e service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-bcef0354-391a-48c5-a113-8a83a90898f8 req-f0ca5ef8-cf9f-4c13-a06d-9e5d14a4648e service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] No waiting events found dispatching network-vif-unplugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-bcef0354-391a-48c5-a113-8a83a90898f8 req-f0ca5ef8-cf9f-4c13-a06d-9e5d14a4648e service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-vif-unplugged-21d53194-906d-4d43-8a10-dc04180809ef for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-2100fc30-73db-4914-843a-8739beb9e9f0 req-12c5d42b-fc90-422f-a1de-1a3009d836ed service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received event network-vif-unplugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2100fc30-73db-4914-843a-8739beb9e9f0 req-12c5d42b-fc90-422f-a1de-1a3009d836ed service nova] Acquiring lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2100fc30-73db-4914-843a-8739beb9e9f0 req-12c5d42b-fc90-422f-a1de-1a3009d836ed service nova] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2100fc30-73db-4914-843a-8739beb9e9f0 req-12c5d42b-fc90-422f-a1de-1a3009d836ed service nova] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-2100fc30-73db-4914-843a-8739beb9e9f0 req-12c5d42b-fc90-422f-a1de-1a3009d836ed service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] No waiting events found dispatching network-vif-unplugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-2100fc30-73db-4914-843a-8739beb9e9f0 req-12c5d42b-fc90-422f-a1de-1a3009d836ed service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received event network-vif-unplugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Instance destroyed successfully.
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.objects.instance [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lazy-loading 'resources' on Instance uuid 12b4c420-79fd-4f58-a422-59dc2b89731f {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:27:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Instance destroyed successfully.
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.objects.instance [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'resources' on Instance uuid d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-896436249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-896436249',id=3,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:07:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c002a125aec54fa388965a9f83cc1624',ramdisk_id='',reservation_id='r-c0vy8pje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:09:08Z,user_data=None,user_id='e2ca09ce37384d25931eb9a658384255',uuid=12b4c420-79fd-4f58-a422-59dc2b89731f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converting VIF {"id": "21d53194-906d-4d43-8a10-dc04180809ef", "address": "fa:16:3e:d2:23:7f", "network": {"id": "97eaa0be-aa09-4365-ad61-197cc71fd3eb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-600893163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c002a125aec54fa388965a9f83cc1624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d53194-90", "ovs_interfaceid": "21d53194-906d-4d43-8a10-dc04180809ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:23:7f,bridge_name='br-int',has_traffic_filtering=True,id=21d53194-906d-4d43-8a10-dc04180809ef,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d53194-90') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG os_vif [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:23:7f,bridge_name='br-int',has_traffic_filtering=True,id=21d53194-906d-4d43-8a10-dc04180809ef,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d53194-90') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-362773906',display_name='tempest-AttachVolumeNegativeTest-server-362773906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-362773906',id=30,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsEZiuI3N82+Yz3r26vJMJ+5ZiaiqyeqrGbvTNdtYgzMBNvh/AR6nSoWJwkbnxuBUijtLT6Fh2z+4k8j3X9EqiUWmlQ/S/lmTZULkbtrADyvhHnSUD5oin0kKs7xziTiw==',key_name='tempest-keypair-77818563',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:24:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-sxuuz7eu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "address": "fa:16:3e:ad:29:f0", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5284438-c3", "ovs_interfaceid": "d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:29:f0,bridge_name='br-int',has_traffic_filtering=True,id=d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5284438-c3') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG os_vif [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:29:f0,bridge_name='br-int',has_traffic_filtering=True,id=d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5284438-c3') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21d53194-90, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5284438-c3, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=573f6901-d475-4472-b4e2-6a31557e8b99) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f69437ed-18c0-4763-9827-86a701d518cb) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:27:41 user nova-compute[74587]: INFO os_vif [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:23:7f,bridge_name='br-int',has_traffic_filtering=True,id=21d53194-906d-4d43-8a10-dc04180809ef,network=Network(97eaa0be-aa09-4365-ad61-197cc71fd3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d53194-90')
Oct 18 07:27:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Deleting instance files /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f_del
Oct 18 07:27:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Deletion of /opt/stack/data/nova/instances/12b4c420-79fd-4f58-a422-59dc2b89731f_del complete
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:27:41 user nova-compute[74587]: INFO os_vif [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:29:f0,bridge_name='br-int',has_traffic_filtering=True,id=d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5284438-c3')
Oct 18 07:27:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Deleting instance files /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db_del
Oct 18 07:27:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Deletion of /opt/stack/data/nova/instances/d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db_del complete
Oct 18 07:27:41 user nova-compute[74587]: INFO nova.compute.manager [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Took 1.34 seconds to destroy the instance on the hypervisor.
Oct 18 07:27:41 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:27:41 user nova-compute[74587]: INFO nova.compute.manager [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 18 07:27:41 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:27:42 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Took 0.50 seconds to deallocate network for instance.
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-baa723d3-9a22-49b8-955a-e6751e46c410 req-b82a2f5e-1418-4f2d-83c4-0bde5c824135 service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-vif-deleted-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:42 user nova-compute[74587]: INFO nova.compute.manager [req-baa723d3-9a22-49b8-955a-e6751e46c410 req-b82a2f5e-1418-4f2d-83c4-0bde5c824135 service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Neutron deleted interface 21d53194-906d-4d43-8a10-dc04180809ef; detaching it from the instance and deleting it from the info cache
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-baa723d3-9a22-49b8-955a-e6751e46c410 req-b82a2f5e-1418-4f2d-83c4-0bde5c824135 service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-baa723d3-9a22-49b8-955a-e6751e46c410 req-b82a2f5e-1418-4f2d-83c4-0bde5c824135 service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Detach interface failed, port_id=21d53194-906d-4d43-8a10-dc04180809ef, reason: Instance 12b4c420-79fd-4f58-a422-59dc2b89731f could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:42 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Deleted allocations for instance 12b4c420-79fd-4f58-a422-59dc2b89731f
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2daf2276-758f-4fee-b3b1-597fad31b4a8 tempest-ServerBootFromVolumeStableRescueTest-1990729548 tempest-ServerBootFromVolumeStableRescueTest-1990729548-project-member] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.259s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:27:42 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Took 0.92 seconds to deallocate network for instance.
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] No waiting events found dispatching network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:27:42 user nova-compute[74587]: WARNING nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received unexpected event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef for instance with vm_state deleted and task_state None.
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] No waiting events found dispatching network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:27:42 user nova-compute[74587]: WARNING nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received unexpected event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef for instance with vm_state deleted and task_state None.
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] No waiting events found dispatching network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:27:42 user nova-compute[74587]: WARNING nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received unexpected event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef for instance with vm_state deleted and task_state None.
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-vif-unplugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] No waiting events found dispatching network-vif-unplugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:27:42 user nova-compute[74587]: WARNING nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received unexpected event network-vif-unplugged-21d53194-906d-4d43-8a10-dc04180809ef for instance with vm_state deleted and task_state None.
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Acquiring lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] Lock "12b4c420-79fd-4f58-a422-59dc2b89731f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] No waiting events found dispatching network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:27:42 user nova-compute[74587]: WARNING nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: 12b4c420-79fd-4f58-a422-59dc2b89731f] Received unexpected event network-vif-plugged-21d53194-906d-4d43-8a10-dc04180809ef for instance with vm_state deleted and task_state None.
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-11c18e80-321b-4499-8df3-1918a1b646dd req-fedda0c3-3589-4672-9086-77fafcc25aba service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received event network-vif-deleted-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:27:42 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:27:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:43 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Deleted allocations for instance d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db
Oct 18 07:27:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-65112456-4db9-41a5-b879-6610ed79aa38 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.485s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-51bf8fe4-1b47-4279-aa86-f358e067acb4 req-5c10fb1d-1c4a-4b97-ae3c-74d2342d8ded service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received event network-vif-plugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:27:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-51bf8fe4-1b47-4279-aa86-f358e067acb4 req-5c10fb1d-1c4a-4b97-ae3c-74d2342d8ded service nova] Acquiring lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:27:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-51bf8fe4-1b47-4279-aa86-f358e067acb4 req-5c10fb1d-1c4a-4b97-ae3c-74d2342d8ded service nova] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:27:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-51bf8fe4-1b47-4279-aa86-f358e067acb4 req-5c10fb1d-1c4a-4b97-ae3c-74d2342d8ded service nova] Lock "d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:27:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-51bf8fe4-1b47-4279-aa86-f358e067acb4 req-5c10fb1d-1c4a-4b97-ae3c-74d2342d8ded service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] No waiting events found dispatching network-vif-plugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:27:43 user nova-compute[74587]: WARNING nova.compute.manager [req-51bf8fe4-1b47-4279-aa86-f358e067acb4 req-5c10fb1d-1c4a-4b97-ae3c-74d2342d8ded service nova] [instance: d3dafc90-7f5f-4b90-99b1-5cfc9fbc05db] Received unexpected event network-vif-plugged-d5284438-c32e-4b3b-8c8f-f2fcf3cbbca2 for instance with vm_state deleted and task_state None.
Oct 18 07:27:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:27:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:27:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:27:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:27:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:27:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:28:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:28:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:28:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:28:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:28:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:28:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-7eb3e8e4-1d10-4da1-a2b8-a54f15838760 req-ece7ae78-0e31-49ec-b804-8e558d607c98 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received event network-changed-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-7eb3e8e4-1d10-4da1-a2b8-a54f15838760 req-ece7ae78-0e31-49ec-b804-8e558d607c98 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Refreshing instance network info cache due to event network-changed-ae95937e-2772-434a-8a14-8f361e17775a. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:28:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7eb3e8e4-1d10-4da1-a2b8-a54f15838760 req-ece7ae78-0e31-49ec-b804-8e558d607c98 service nova] Acquiring lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7eb3e8e4-1d10-4da1-a2b8-a54f15838760 req-ece7ae78-0e31-49ec-b804-8e558d607c98 service nova] Acquired lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:12 user nova-compute[74587]: DEBUG nova.network.neutron [req-7eb3e8e4-1d10-4da1-a2b8-a54f15838760 req-ece7ae78-0e31-49ec-b804-8e558d607c98 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Refreshing network info cache for port ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:28:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-7eb3e8e4-1d10-4da1-a2b8-a54f15838760 req-ece7ae78-0e31-49ec-b804-8e558d607c98 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updated VIF entry in instance network info cache for port ae95937e-2772-434a-8a14-8f361e17775a. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:28:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-7eb3e8e4-1d10-4da1-a2b8-a54f15838760 req-ece7ae78-0e31-49ec-b804-8e558d607c98 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updating instance_info_cache with network_info: [{"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7eb3e8e4-1d10-4da1-a2b8-a54f15838760 req-ece7ae78-0e31-49ec-b804-8e558d607c98 service nova] Releasing lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Stashing vm_state: active {{(pid=74587) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:28:14 user nova-compute[74587]: INFO nova.compute.claims [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Claim successful on node user
Oct 18 07:28:14 user nova-compute[74587]: INFO nova.compute.resource_tracker [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating resource usage from migration a3558a2f-d9db-44c1-9fcb-82025fd3c969
Oct 18 07:28:14 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.325s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:14 user nova-compute[74587]: INFO nova.compute.manager [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Migrating
Oct 18 07:28:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-89bdb041-6284-4550-9e25-8b0846559e7d req-4f2f87a6-b1c3-49f9-8429-bf72fddb5e89 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-changed-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-89bdb041-6284-4550-9e25-8b0846559e7d req-4f2f87a6-b1c3-49f9-8429-bf72fddb5e89 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Refreshing instance network info cache due to event network-changed-e6c2a831-ec15-4209-82ee-ebfdea1813fa. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89bdb041-6284-4550-9e25-8b0846559e7d req-4f2f87a6-b1c3-49f9-8429-bf72fddb5e89 service nova] Acquiring lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89bdb041-6284-4550-9e25-8b0846559e7d req-4f2f87a6-b1c3-49f9-8429-bf72fddb5e89 service nova] Acquired lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-89bdb041-6284-4550-9e25-8b0846559e7d req-4f2f87a6-b1c3-49f9-8429-bf72fddb5e89 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Refreshing network info cache for port e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:28:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-89bdb041-6284-4550-9e25-8b0846559e7d req-4f2f87a6-b1c3-49f9-8429-bf72fddb5e89 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updated VIF entry in instance network info cache for port e6c2a831-ec15-4209-82ee-ebfdea1813fa. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:28:15 user nova-compute[74587]: DEBUG nova.network.neutron [req-89bdb041-6284-4550-9e25-8b0846559e7d req-4f2f87a6-b1c3-49f9-8429-bf72fddb5e89 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating instance_info_cache with network_info: [{"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89bdb041-6284-4550-9e25-8b0846559e7d req-4f2f87a6-b1c3-49f9-8429-bf72fddb5e89 service nova] Releasing lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquired lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:15 user nova-compute[74587]: DEBUG nova.network.neutron [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:28:15 user nova-compute[74587]: DEBUG nova.network.neutron [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating instance_info_cache with network_info: [{"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Releasing lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Starting migrate_disk_and_power_off {{(pid=74587) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-200966a2-cacc-41ff-9fa8-ede7e5318f82 req-c5fd0643-4cec-4f0a-b3b7-a122de9bed96 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-vif-unplugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-200966a2-cacc-41ff-9fa8-ede7e5318f82 req-c5fd0643-4cec-4f0a-b3b7-a122de9bed96 service nova] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-200966a2-cacc-41ff-9fa8-ede7e5318f82 req-c5fd0643-4cec-4f0a-b3b7-a122de9bed96 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-200966a2-cacc-41ff-9fa8-ede7e5318f82 req-c5fd0643-4cec-4f0a-b3b7-a122de9bed96 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-200966a2-cacc-41ff-9fa8-ede7e5318f82 req-c5fd0643-4cec-4f0a-b3b7-a122de9bed96 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] No waiting events found dispatching network-vif-unplugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:16 user nova-compute[74587]: WARNING nova.compute.manager [req-200966a2-cacc-41ff-9fa8-ede7e5318f82 req-c5fd0643-4cec-4f0a-b3b7-a122de9bed96 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received unexpected event network-vif-unplugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa for instance with vm_state active and task_state resize_migrating.
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: bb153556-57ca-4401-894a-e3588a05e460] Instance destroyed successfully.
Oct 18 07:28:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1974074510',display_name='tempest-ServerActionsTestOtherA-server-1974074510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1974074510',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA52QLTWvy/v2jV8SnvcFET/QtPPTqG94sHIUJ+eIA4fj3Aw4bOkxeUXjNyfaIA0FLk6wcOPrhSmuqIwPWgig8KHxvH3mp04gQBlQsoVn3vpHBaDRDx2a25MshLKHMkpQ==',key_name='tempest-keypair-952803272',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-9tmk55cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=bb153556-57ca-4401-894a-e3588a05e460,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-655313875-network", "vif_mac": "fa:16:3e:68:56:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-655313875-network", "vif_mac": "fa:16:3e:68:56:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_vif [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6c2a831-ec, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af8cf80f-8023-42e0-b812-76d1fcc2ae38) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:16 user nova-compute[74587]: INFO os_vif [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec')
Oct 18 07:28:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glFnWiTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:28:16 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b964f2bc-1f21-4404-a1d9-a311aa3f7c79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:28:16 user nova-compute[74587]: No targets found.
Oct 18 07:28:16 user nova-compute[74587]: iSNS:
Oct 18 07:28:16 user nova-compute[74587]: No targets found.
Oct 18 07:28:16 user nova-compute[74587]: STATIC:
Oct 18 07:28:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039
Oct 18 07:28:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:28:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:28:16 user nova-compute[74587]: FIRMWARE:
Oct 18 07:28:16 user nova-compute[74587]: No targets found.
Oct 18 07:28:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:28:16 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:28:16 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[071c050f-a91f-4681-a569-4e3fb6f30f9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5181aaa9-ae11-4a13-84e7-ac992388eafc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:28:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:28:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe430feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[716bdebd-a351-4846-a44c-a9e204bf09e6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1de7a6-b554-4adc-a9cb-e6b9d985eac3]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5088ff1f-668e-4c0b-8e7a-ef8bb50bd0bd]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ede945-9731-46d0-809b-f126f4d6999f]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb09ed3ed-77ec5959b540e5cd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b09ed3ed', '/dev/disk/by-id/scsi-23737656335393539') {{(pid=85802) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9748f0c9-b80e-4eab-b300-0a114a3f8570]: (4, None) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[58440558-9355-4471-ad7d-628413f6ec3d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b684bda-6b1d-490c-89e9-762ccae84f5d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260]
Oct 18 07:28:17 user nova-compute[74587]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260] successful.
Oct 18 07:28:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c90e3a-cb2b-4d54-8197-1453b869828d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== disconnect_volume: return (323ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG nova.network.neutron [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Port e6c2a831-ec15-4209-82ee-ebfdea1813fa binding to destination host user is already ACTIVE {{(pid=74587) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquired lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG nova.network.neutron [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG nova.compute.manager [req-6b1b2c81-9946-4116-b751-326de62cbc1b req-850be191-c5f8-4360-89e5-dbb86e930523 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6b1b2c81-9946-4116-b751-326de62cbc1b req-850be191-c5f8-4360-89e5-dbb86e930523 service nova] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6b1b2c81-9946-4116-b751-326de62cbc1b req-850be191-c5f8-4360-89e5-dbb86e930523 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6b1b2c81-9946-4116-b751-326de62cbc1b req-850be191-c5f8-4360-89e5-dbb86e930523 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:18 user nova-compute[74587]: DEBUG nova.compute.manager [req-6b1b2c81-9946-4116-b751-326de62cbc1b req-850be191-c5f8-4360-89e5-dbb86e930523 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] No waiting events found dispatching network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:18 user nova-compute[74587]: WARNING nova.compute.manager [req-6b1b2c81-9946-4116-b751-326de62cbc1b req-850be191-c5f8-4360-89e5-dbb86e930523 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received unexpected event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa for instance with vm_state active and task_state resize_migrated.
Oct 18 07:28:19 user nova-compute[74587]: DEBUG nova.network.neutron [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating instance_info_cache with network_info: [{"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Releasing lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG os_brick.utils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeed3d3a-68a8-489d-bb62-484f846b3449]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1285f77-52cd-42a8-97c0-34854e62b6b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19ebf8b-bc44-4d88-a611-89395aa5c6ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[92acd9cf-184c-45fb-bd3a-a846a84032d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:28:19 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:28:19 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83b8bd7-6bde-45e8-9731-c7a783ecd327]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:28:19 user nova-compute[74587]: DEBUG os_brick.utils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:28:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:28:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:21 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:21 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:28:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:28:21 user nova-compute[74587]: INFO nova.compute.claims [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Claim successful on node user
Oct 18 07:28:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG nova.network.neutron [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:28:22 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:28:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG nova.policy [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd13de789e98e4ba9ad22d665ff8e4ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cfa00773ba4c5498c56b84ccb307a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:28:22 user nova-compute[74587]: INFO nova.virt.block_device [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Booting with volume fb77fe70-658d-4680-a2da-79b135918740 at /dev/vda
Oct 18 07:28:22 user nova-compute[74587]: DEBUG os_brick.utils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f13fe8f-9689-4708-a457-0649f8b10e7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9830847-6238-497d-bf6f-f8ebc250827e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd10469b-fbc3-4b1e-a30f-85350c535fca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[763fb1c1-15fc-4e11-a91d-edba5dcbb578]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:28:22 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:28:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[348970fa-45fc-4e08-9733-f4078ae21338]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG os_brick.utils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:28:22 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Updating existing volume attachment record: 768ea152-763b-4fe5-948c-80c3e06270db {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:28:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Successfully created port: 9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:28:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Successfully updated port: 9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:28:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "refresh_cache-3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquired lock "refresh_cache-3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:28:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-42d71210-277e-4cbe-8096-fb04b2c37696 req-535fa0ce-1e10-4431-970a-d1f241298488 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received event network-changed-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-42d71210-277e-4cbe-8096-fb04b2c37696 req-535fa0ce-1e10-4431-970a-d1f241298488 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Refreshing instance network info cache due to event network-changed-9226b6ed-6daa-43b7-805f-914e78250743. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:28:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-42d71210-277e-4cbe-8096-fb04b2c37696 req-535fa0ce-1e10-4431-970a-d1f241298488 service nova] Acquiring lock "refresh_cache-3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:28:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Updating instance_info_cache with network_info: [{"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Releasing lock "refresh_cache-3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:24 user nova-compute[74587]: DEBUG nova.compute.manager [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Instance network_info: |[{"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:28:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-42d71210-277e-4cbe-8096-fb04b2c37696 req-535fa0ce-1e10-4431-970a-d1f241298488 service nova] Acquired lock "refresh_cache-3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:24 user nova-compute[74587]: DEBUG nova.network.neutron [req-42d71210-277e-4cbe-8096-fb04b2c37696 req-535fa0ce-1e10-4431-970a-d1f241298488 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Refreshing network info cache for port 9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:28:25 user nova-compute[74587]: DEBUG nova.network.neutron [req-42d71210-277e-4cbe-8096-fb04b2c37696 req-535fa0ce-1e10-4431-970a-d1f241298488 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Updated VIF entry in instance network info cache for port 9226b6ed-6daa-43b7-805f-914e78250743. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:28:25 user nova-compute[74587]: DEBUG nova.network.neutron [req-42d71210-277e-4cbe-8096-fb04b2c37696 req-535fa0ce-1e10-4431-970a-d1f241298488 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Updating instance_info_cache with network_info: [{"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-42d71210-277e-4cbe-8096-fb04b2c37696 req-535fa0ce-1e10-4431-970a-d1f241298488 service nova] Releasing lock "refresh_cache-3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:28:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:26 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:28:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:27 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Updating instance_info_cache with network_info: [{"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:27 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:28:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:30 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:30 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:30 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=25.33193588256836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:28:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:30 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Applying migration context for instance bb153556-57ca-4401-894a-e3588a05e460 as it has an incoming, in-progress migration a3558a2f-d9db-44c1-9fcb-82025fd3c969. Migration status is post-migrating {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 18 07:28:30 user nova-compute[74587]: INFO nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating resource usage from migration a3558a2f-d9db-44c1-9fcb-82025fd3c969
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 665a2f6d-4704-400e-aeca-ae8cb29333da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Migration a3558a2f-d9db-44c1-9fcb-82025fd3c969 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance bb153556-57ca-4401-894a-e3588a05e460 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.729s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:28:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:28:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:35 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:28:35 user nova-compute[74587]: INFO nova.compute.claims [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Claim successful on node user
Oct 18 07:28:35 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:28:35 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:28:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:28:36 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:28:36 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:28:36 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Creating image(s)
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "/opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "/opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "/opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG nova.policy [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a52acb7a2a064b5dace4f4601efb26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100753d7cc0347f880d9e22fe1e17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.250s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.214s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk 1073741824" returned: 0 in 0.063s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "31fa8ba1-a21e-43b9-9916-2e9245087107" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:36 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:28:37 user nova-compute[74587]: INFO nova.compute.claims [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Claim successful on node user
Oct 18 07:28:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Cannot resize image /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Ensure instance console log exists: /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Starting finish_migration {{(pid=74587) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Instance directory exists: not creating {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 07:28:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Creating image(s)
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Ensure instance console log exists: /opt/stack/data/nova/instances/bb153556-57ca-4401-894a-e3588a05e460/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Start _get_guest_xml network_info=[{"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-655313875-network", "vif_mac": "fa:16:3e:68:56:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '20f7a546-527a-489a-b9b7-c5787229f1e2', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glFnWiTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bb153556-57ca-4401-894a-e3588a05e460', 'attached_at': '2023-10-18T07:28:37.000000', 'detached_at': '', 'volume_id': '3d811b23-c02f-433f-99ea-ea4bd3426039', 'serial': '3d811b23-c02f-433f-99ea-ea4bd3426039'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:28:37 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:37 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glFnWiTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:28:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:28:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:28:37 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e2929f-d7b7-41b0-be32-a58c914e6d2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:28:37 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57f4568-eadd-4960-a796-b4c68c7ade2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039] added
Oct 18 07:28:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a6ee0e-6345-45bf-af4f-a9a729f40799]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f533f609-d41d-4096-b3de-4c45508911be]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glFnWiTN {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glFnWiTN" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017ad68-fcbc-4f6b-993d-967cfed665a2]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'glFnWiTN'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a814350-b2af-48fa-b7e5-46015c7ddb99]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1886ad3-17b1-4910-8ad7-588dcf24ace1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:28:37 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:28:37 user nova-compute[74587]:  {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:28:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 07:28:37 user nova-compute[74587]: 
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:28:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcd69af-f6f8-46a3-b166-74f13deed899]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260]
Oct 18 07:28:37 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260] successful.
Oct 18 07:28:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cbc69a-7ad6-4363-942a-9181ea93881d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6141b541-1c62-4ac1-8336-cb0ec4c33580]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:28:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:28:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[632b6534-e33f-418f-a036-1f374218e6bd]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glFnWiTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG nova.policy [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aceede4662a4aaa92c79dfd538effea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc0eafb55fd4673a3d8fcb0e63602c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:28:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Creating image(s)
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "/opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "/opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "/opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.222s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Successfully created port: 9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.202s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk 1073741824" returned: 0 in 0.061s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Successfully created port: c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23737656335393539', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737656335393539', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Cannot resize image /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Ensure instance console log exists: /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1974074510',display_name='tempest-ServerActionsTestOtherA-server-1974074510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1974074510',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA52QLTWvy/v2jV8SnvcFET/QtPPTqG94sHIUJ+eIA4fj3Aw4bOkxeUXjNyfaIA0FLk6wcOPrhSmuqIwPWgig8KHxvH3mp04gQBlQsoVn3vpHBaDRDx2a25MshLKHMkpQ==',key_name='tempest-keypair-952803272',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-9tmk55cz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=bb153556-57ca-4401-894a-e3588a05e460,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-655313875-network", "vif_mac": "fa:16:3e:68:56:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-655313875-network", "vif_mac": "fa:16:3e:68:56:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:28:39 user nova-compute[74587]:   <uuid>bb153556-57ca-4401-894a-e3588a05e460</uuid>
Oct 18 07:28:39 user nova-compute[74587]:   <name>instance-00000020</name>
Oct 18 07:28:39 user nova-compute[74587]:   <memory>2097152</memory>
Oct 18 07:28:39 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:28:39 user nova-compute[74587]:   <metadata>
Oct 18 07:28:39 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:28:39 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:28:39 user nova-compute[74587]:       <nova:name>tempest-ServerActionsTestOtherA-server-1974074510</nova:name>
Oct 18 07:28:39 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:28:37</nova:creationTime>
Oct 18 07:28:39 user nova-compute[74587]:       <nova:flavor name="m1.small">
Oct 18 07:28:39 user nova-compute[74587]:         <nova:memory>2048</nova:memory>
Oct 18 07:28:39 user nova-compute[74587]:         <nova:disk>20</nova:disk>
Oct 18 07:28:39 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:28:39 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:28:39 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:28:39 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:28:39 user nova-compute[74587]:       <nova:owner>
Oct 18 07:28:39 user nova-compute[74587]:         <nova:user uuid="1b1730cd79c54e748232c046b4d3e412">tempest-ServerActionsTestOtherA-2039083727-project-member</nova:user>
Oct 18 07:28:39 user nova-compute[74587]:         <nova:project uuid="196ea516329b4e479bd8f54644007c57">tempest-ServerActionsTestOtherA-2039083727</nova:project>
Oct 18 07:28:39 user nova-compute[74587]:       </nova:owner>
Oct 18 07:28:39 user nova-compute[74587]:       <nova:ports>
Oct 18 07:28:39 user nova-compute[74587]:         <nova:port uuid="e6c2a831-ec15-4209-82ee-ebfdea1813fa">
Oct 18 07:28:39 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 07:28:39 user nova-compute[74587]:         </nova:port>
Oct 18 07:28:39 user nova-compute[74587]:       </nova:ports>
Oct 18 07:28:39 user nova-compute[74587]:     </nova:instance>
Oct 18 07:28:39 user nova-compute[74587]:   </metadata>
Oct 18 07:28:39 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:28:39 user nova-compute[74587]:     <system>
Oct 18 07:28:39 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:28:39 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:28:39 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:28:39 user nova-compute[74587]:       <entry name="serial">bb153556-57ca-4401-894a-e3588a05e460</entry>
Oct 18 07:28:39 user nova-compute[74587]:       <entry name="uuid">bb153556-57ca-4401-894a-e3588a05e460</entry>
Oct 18 07:28:39 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:28:39 user nova-compute[74587]:     </system>
Oct 18 07:28:39 user nova-compute[74587]:   </sysinfo>
Oct 18 07:28:39 user nova-compute[74587]:   <os>
Oct 18 07:28:39 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:28:39 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:28:39 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:28:39 user nova-compute[74587]:   </os>
Oct 18 07:28:39 user nova-compute[74587]:   <features>
Oct 18 07:28:39 user nova-compute[74587]:     <acpi/>
Oct 18 07:28:39 user nova-compute[74587]:     <apic/>
Oct 18 07:28:39 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:28:39 user nova-compute[74587]:   </features>
Oct 18 07:28:39 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:28:39 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:28:39 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:28:39 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:28:39 user nova-compute[74587]:   </clock>
Oct 18 07:28:39 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:28:39 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:28:39 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:28:39 user nova-compute[74587]:   </cpu>
Oct 18 07:28:39 user nova-compute[74587]:   <devices>
Oct 18 07:28:39 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:28:39 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:28:39 user nova-compute[74587]:       <source dev="/dev/sdb"/>
Oct 18 07:28:39 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:28:39 user nova-compute[74587]:       <serial>3d811b23-c02f-433f-99ea-ea4bd3426039</serial>
Oct 18 07:28:39 user nova-compute[74587]:     </disk>
Oct 18 07:28:39 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:28:39 user nova-compute[74587]:       <mac address="fa:16:3e:68:56:dd"/>
Oct 18 07:28:39 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:28:39 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:28:39 user nova-compute[74587]:       <target dev="tape6c2a831-ec"/>
Oct 18 07:28:39 user nova-compute[74587]:     </interface>
Oct 18 07:28:39 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:28:39 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/bb153556-57ca-4401-894a-e3588a05e460/console.log" append="off"/>
Oct 18 07:28:39 user nova-compute[74587]:     </serial>
Oct 18 07:28:39 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:28:39 user nova-compute[74587]:     <video>
Oct 18 07:28:39 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:28:39 user nova-compute[74587]:     </video>
Oct 18 07:28:39 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:28:39 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:28:39 user nova-compute[74587]:     </rng>
Oct 18 07:28:39 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:28:39 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:28:39 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:28:39 user nova-compute[74587]:     </memballoon>
Oct 18 07:28:39 user nova-compute[74587]:   </devices>
Oct 18 07:28:39 user nova-compute[74587]: </domain>
Oct 18 07:28:39 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1974074510',display_name='tempest-ServerActionsTestOtherA-server-1974074510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1974074510',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA52QLTWvy/v2jV8SnvcFET/QtPPTqG94sHIUJ+eIA4fj3Aw4bOkxeUXjNyfaIA0FLk6wcOPrhSmuqIwPWgig8KHxvH3mp04gQBlQsoVn3vpHBaDRDx2a25MshLKHMkpQ==',key_name='tempest-keypair-952803272',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-9tmk55cz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=bb153556-57ca-4401-894a-e3588a05e460,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-655313875-network", "vif_mac": "fa:16:3e:68:56:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-655313875-network", "vif_mac": "fa:16:3e:68:56:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG os_vif [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4ad5865-f1b0-59d3-9cf6-62b145aed8a5', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6c2a831-ec, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6c2a831-ec, col_values=(('qos', UUID('6b7af8f2-369e-4992-a3b2-a46142034563')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6c2a831-ec, col_values=(('external_ids', {'iface-id': 'e6c2a831-ec15-4209-82ee-ebfdea1813fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:56:dd', 'vm-uuid': 'bb153556-57ca-4401-894a-e3588a05e460'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:39 user nova-compute[74587]: INFO os_vif [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec')
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] No VIF found with MAC fa:16:3e:68:56:dd, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Successfully updated port: 9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "refresh_cache-16088b21-6f4c-4bb5-82e4-51946f015ffd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquired lock "refresh_cache-16088b21-6f4c-4bb5-82e4-51946f015ffd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-297e264e-5660-462c-829a-e3d6b4ae628f req-0a6107c0-67cc-4851-ac6d-018247d65d64 service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received event network-changed-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-297e264e-5660-462c-829a-e3d6b4ae628f req-0a6107c0-67cc-4851-ac6d-018247d65d64 service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Refreshing instance network info cache due to event network-changed-9b4d296c-113e-48e2-a7f7-b18127f93fc0. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-297e264e-5660-462c-829a-e3d6b4ae628f req-0a6107c0-67cc-4851-ac6d-018247d65d64 service nova] Acquiring lock "refresh_cache-16088b21-6f4c-4bb5-82e4-51946f015ffd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Updating instance_info_cache with network_info: [{"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Successfully updated port: c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Releasing lock "refresh_cache-16088b21-6f4c-4bb5-82e4-51946f015ffd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Instance network_info: |[{"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-297e264e-5660-462c-829a-e3d6b4ae628f req-0a6107c0-67cc-4851-ac6d-018247d65d64 service nova] Acquired lock "refresh_cache-16088b21-6f4c-4bb5-82e4-51946f015ffd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-297e264e-5660-462c-829a-e3d6b4ae628f req-0a6107c0-67cc-4851-ac6d-018247d65d64 service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Refreshing network info cache for port 9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Start _get_guest_xml network_info=[{"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "refresh_cache-31fa8ba1-a21e-43b9-9916-2e9245087107" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquired lock "refresh_cache-31fa8ba1-a21e-43b9-9916-2e9245087107" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:28:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-192360483',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-192360483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1923604',id=34,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVuxU8Sx7b5ErQemraYdmJrDDBZvX6nosdW3OmVse75x7l52vWgfjWHuEMdFRznErmXgNXcBgAn5PI3MOLmIl7DbRlPHZ7iIOAFvIbz39JxUWVvmyembLPM5tbglqs1Rg==',key_name='tempest-keypair-1258510081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='100753d7cc0347f880d9e22fe1e17243',ramdisk_id='',reservation_id='r-bglf6mhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-273184500',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52acb7a2a064b5dace4f4601efb26bd',uuid=16088b21-6f4c-4bb5-82e4-51946f015ffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Converting VIF {"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:91:17,bridge_name='br-int',has_traffic_filtering=True,id=9b4d296c-113e-48e2-a7f7-b18127f93fc0,network=Network(4b83d1bf-e592-4623-83f2-6141e8a7fd2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4d296c-11') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lazy-loading 'pci_devices' on Instance uuid 16088b21-6f4c-4bb5-82e4-51946f015ffd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:28:40 user nova-compute[74587]:   <uuid>16088b21-6f4c-4bb5-82e4-51946f015ffd</uuid>
Oct 18 07:28:40 user nova-compute[74587]:   <name>instance-00000022</name>
Oct 18 07:28:40 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:28:40 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:28:40 user nova-compute[74587]:   <metadata>
Oct 18 07:28:40 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:28:40 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-192360483</nova:name>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:28:40</nova:creationTime>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:28:40 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:28:40 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:owner>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:user uuid="a52acb7a2a064b5dace4f4601efb26bd">tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member</nova:user>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:project uuid="100753d7cc0347f880d9e22fe1e17243">tempest-TestServerVolumeAttachScenarioOldVersion-273184500</nova:project>
Oct 18 07:28:40 user nova-compute[74587]:       </nova:owner>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:ports>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:port uuid="9b4d296c-113e-48e2-a7f7-b18127f93fc0">
Oct 18 07:28:40 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 07:28:40 user nova-compute[74587]:         </nova:port>
Oct 18 07:28:40 user nova-compute[74587]:       </nova:ports>
Oct 18 07:28:40 user nova-compute[74587]:     </nova:instance>
Oct 18 07:28:40 user nova-compute[74587]:   </metadata>
Oct 18 07:28:40 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:28:40 user nova-compute[74587]:     <system>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="serial">16088b21-6f4c-4bb5-82e4-51946f015ffd</entry>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="uuid">16088b21-6f4c-4bb5-82e4-51946f015ffd</entry>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:28:40 user nova-compute[74587]:     </system>
Oct 18 07:28:40 user nova-compute[74587]:   </sysinfo>
Oct 18 07:28:40 user nova-compute[74587]:   <os>
Oct 18 07:28:40 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:28:40 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:28:40 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:28:40 user nova-compute[74587]:   </os>
Oct 18 07:28:40 user nova-compute[74587]:   <features>
Oct 18 07:28:40 user nova-compute[74587]:     <acpi/>
Oct 18 07:28:40 user nova-compute[74587]:     <apic/>
Oct 18 07:28:40 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:28:40 user nova-compute[74587]:   </features>
Oct 18 07:28:40 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:28:40 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:28:40 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:28:40 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:28:40 user nova-compute[74587]:   </clock>
Oct 18 07:28:40 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:28:40 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:28:40 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:28:40 user nova-compute[74587]:   </cpu>
Oct 18 07:28:40 user nova-compute[74587]:   <devices>
Oct 18 07:28:40 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:28:40 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:28:40 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk"/>
Oct 18 07:28:40 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:28:40 user nova-compute[74587]:     </disk>
Oct 18 07:28:40 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:28:40 user nova-compute[74587]:       <mac address="fa:16:3e:80:91:17"/>
Oct 18 07:28:40 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:28:40 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:28:40 user nova-compute[74587]:       <target dev="tap9b4d296c-11"/>
Oct 18 07:28:40 user nova-compute[74587]:     </interface>
Oct 18 07:28:40 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:28:40 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/console.log" append="off"/>
Oct 18 07:28:40 user nova-compute[74587]:     </serial>
Oct 18 07:28:40 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:28:40 user nova-compute[74587]:     <video>
Oct 18 07:28:40 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:28:40 user nova-compute[74587]:     </video>
Oct 18 07:28:40 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:28:40 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:28:40 user nova-compute[74587]:     </rng>
Oct 18 07:28:40 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:28:40 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:28:40 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:28:40 user nova-compute[74587]:     </memballoon>
Oct 18 07:28:40 user nova-compute[74587]:   </devices>
Oct 18 07:28:40 user nova-compute[74587]: </domain>
Oct 18 07:28:40 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-192360483',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-192360483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1923604',id=34,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVuxU8Sx7b5ErQemraYdmJrDDBZvX6nosdW3OmVse75x7l52vWgfjWHuEMdFRznErmXgNXcBgAn5PI3MOLmIl7DbRlPHZ7iIOAFvIbz39JxUWVvmyembLPM5tbglqs1Rg==',key_name='tempest-keypair-1258510081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='100753d7cc0347f880d9e22fe1e17243',ramdisk_id='',reservation_id='r-bglf6mhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-273184500',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52acb7a2a064b5dace4f4601efb26bd',uuid=16088b21-6f4c-4bb5-82e4-51946f015ffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Converting VIF {"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:91:17,bridge_name='br-int',has_traffic_filtering=True,id=9b4d296c-113e-48e2-a7f7-b18127f93fc0,network=Network(4b83d1bf-e592-4623-83f2-6141e8a7fd2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4d296c-11') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG os_vif [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:91:17,bridge_name='br-int',has_traffic_filtering=True,id=9b4d296c-113e-48e2-a7f7-b18127f93fc0,network=Network(4b83d1bf-e592-4623-83f2-6141e8a7fd2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4d296c-11') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c0c85d4-9c8f-5037-a8c3-9253bf95c6ee', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-df679dcc-dfa5-43d9-855a-1fd1dbe99e4c req-b2f35ae3-b5a5-4197-bc0d-6e4b41a6a8ab service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received event network-changed-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-df679dcc-dfa5-43d9-855a-1fd1dbe99e4c req-b2f35ae3-b5a5-4197-bc0d-6e4b41a6a8ab service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Refreshing instance network info cache due to event network-changed-c1577f59-272d-4419-b256-d124fcc47d4f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-df679dcc-dfa5-43d9-855a-1fd1dbe99e4c req-b2f35ae3-b5a5-4197-bc0d-6e4b41a6a8ab service nova] Acquiring lock "refresh_cache-31fa8ba1-a21e-43b9-9916-2e9245087107" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b4d296c-11, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b4d296c-11, col_values=(('qos', UUID('45daa1f5-4f75-46e2-9cfc-db60d9314c48')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b4d296c-11, col_values=(('external_ids', {'iface-id': '9b4d296c-113e-48e2-a7f7-b18127f93fc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:91:17', 'vm-uuid': '16088b21-6f4c-4bb5-82e4-51946f015ffd'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: INFO os_vif [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:91:17,bridge_name='br-int',has_traffic_filtering=True,id=9b4d296c-113e-48e2-a7f7-b18127f93fc0,network=Network(4b83d1bf-e592-4623-83f2-6141e8a7fd2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4d296c-11')
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] No VIF found with MAC fa:16:3e:80:91:17, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Updating instance_info_cache with network_info: [{"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Releasing lock "refresh_cache-31fa8ba1-a21e-43b9-9916-2e9245087107" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Instance network_info: |[{"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-df679dcc-dfa5-43d9-855a-1fd1dbe99e4c req-b2f35ae3-b5a5-4197-bc0d-6e4b41a6a8ab service nova] Acquired lock "refresh_cache-31fa8ba1-a21e-43b9-9916-2e9245087107" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-df679dcc-dfa5-43d9-855a-1fd1dbe99e4c req-b2f35ae3-b5a5-4197-bc0d-6e4b41a6a8ab service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Refreshing network info cache for port c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Start _get_guest_xml network_info=[{"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:28:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1571661449',display_name='tempest-AttachVolumeNegativeTest-server-1571661449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1571661449',id=35,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiEmsNJcdVCniBy236KaMsJ0fnIHhkkej3j3rVDDqlzF47aQh+w/Z/7P9pX7mPwSpB4c/kFD3xiI7Qpv+4rZjPmsr/czfCn71aeRZRPFBas1pkyuy2MahHH2AQgXgTwsQ==',key_name='tempest-keypair-746089352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-qpwi12qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=31fa8ba1-a21e-43b9-9916-2e9245087107,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=c1577f59-272d-4419-b256-d124fcc47d4f,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1577f59-27') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'pci_devices' on Instance uuid 31fa8ba1-a21e-43b9-9916-2e9245087107 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:28:40 user nova-compute[74587]:   <uuid>31fa8ba1-a21e-43b9-9916-2e9245087107</uuid>
Oct 18 07:28:40 user nova-compute[74587]:   <name>instance-00000023</name>
Oct 18 07:28:40 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:28:40 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:28:40 user nova-compute[74587]:   <metadata>
Oct 18 07:28:40 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:28:40 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1571661449</nova:name>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:28:40</nova:creationTime>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:28:40 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:28:40 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:owner>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:user uuid="8aceede4662a4aaa92c79dfd538effea">tempest-AttachVolumeNegativeTest-859195449-project-member</nova:user>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:project uuid="0cc0eafb55fd4673a3d8fcb0e63602c7">tempest-AttachVolumeNegativeTest-859195449</nova:project>
Oct 18 07:28:40 user nova-compute[74587]:       </nova:owner>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:28:40 user nova-compute[74587]:       <nova:ports>
Oct 18 07:28:40 user nova-compute[74587]:         <nova:port uuid="c1577f59-272d-4419-b256-d124fcc47d4f">
Oct 18 07:28:40 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 07:28:40 user nova-compute[74587]:         </nova:port>
Oct 18 07:28:40 user nova-compute[74587]:       </nova:ports>
Oct 18 07:28:40 user nova-compute[74587]:     </nova:instance>
Oct 18 07:28:40 user nova-compute[74587]:   </metadata>
Oct 18 07:28:40 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:28:40 user nova-compute[74587]:     <system>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="serial">31fa8ba1-a21e-43b9-9916-2e9245087107</entry>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="uuid">31fa8ba1-a21e-43b9-9916-2e9245087107</entry>
Oct 18 07:28:40 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:28:40 user nova-compute[74587]:     </system>
Oct 18 07:28:40 user nova-compute[74587]:   </sysinfo>
Oct 18 07:28:40 user nova-compute[74587]:   <os>
Oct 18 07:28:40 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:28:40 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:28:40 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:28:40 user nova-compute[74587]:   </os>
Oct 18 07:28:40 user nova-compute[74587]:   <features>
Oct 18 07:28:40 user nova-compute[74587]:     <acpi/>
Oct 18 07:28:40 user nova-compute[74587]:     <apic/>
Oct 18 07:28:40 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:28:40 user nova-compute[74587]:   </features>
Oct 18 07:28:40 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:28:40 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:28:40 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:28:40 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:28:40 user nova-compute[74587]:   </clock>
Oct 18 07:28:40 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:28:40 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:28:40 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:28:40 user nova-compute[74587]:   </cpu>
Oct 18 07:28:40 user nova-compute[74587]:   <devices>
Oct 18 07:28:40 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:28:40 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:28:40 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk"/>
Oct 18 07:28:40 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:28:40 user nova-compute[74587]:     </disk>
Oct 18 07:28:40 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:28:40 user nova-compute[74587]:       <mac address="fa:16:3e:42:5e:2f"/>
Oct 18 07:28:40 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:28:40 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:28:40 user nova-compute[74587]:       <target dev="tapc1577f59-27"/>
Oct 18 07:28:40 user nova-compute[74587]:     </interface>
Oct 18 07:28:40 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:28:40 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/console.log" append="off"/>
Oct 18 07:28:40 user nova-compute[74587]:     </serial>
Oct 18 07:28:40 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:28:40 user nova-compute[74587]:     <video>
Oct 18 07:28:40 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:28:40 user nova-compute[74587]:     </video>
Oct 18 07:28:40 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:28:40 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:28:40 user nova-compute[74587]:     </rng>
Oct 18 07:28:40 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:28:40 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:28:40 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:28:40 user nova-compute[74587]:     </memballoon>
Oct 18 07:28:40 user nova-compute[74587]:   </devices>
Oct 18 07:28:40 user nova-compute[74587]: </domain>
Oct 18 07:28:40 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1571661449',display_name='tempest-AttachVolumeNegativeTest-server-1571661449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1571661449',id=35,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiEmsNJcdVCniBy236KaMsJ0fnIHhkkej3j3rVDDqlzF47aQh+w/Z/7P9pX7mPwSpB4c/kFD3xiI7Qpv+4rZjPmsr/czfCn71aeRZRPFBas1pkyuy2MahHH2AQgXgTwsQ==',key_name='tempest-keypair-746089352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-qpwi12qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=31fa8ba1-a21e-43b9-9916-2e9245087107,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=c1577f59-272d-4419-b256-d124fcc47d4f,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1577f59-27') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG os_vif [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=c1577f59-272d-4419-b256-d124fcc47d4f,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1577f59-27') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d19ab08-3cb4-5ca4-b0ec-ce63c65236ca', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Acquiring lock "ba90228d-2d1f-436d-b169-9ef728328f35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "ba90228d-2d1f-436d-b169-9ef728328f35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1577f59-27, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1577f59-27, col_values=(('qos', UUID('a959f033-a851-4bb9-9efc-39d31cc79b32')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1577f59-27, col_values=(('external_ids', {'iface-id': 'c1577f59-272d-4419-b256-d124fcc47d4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:5e:2f', 'vm-uuid': '31fa8ba1-a21e-43b9-9916-2e9245087107'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-297e264e-5660-462c-829a-e3d6b4ae628f req-0a6107c0-67cc-4851-ac6d-018247d65d64 service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Updated VIF entry in instance network info cache for port 9b4d296c-113e-48e2-a7f7-b18127f93fc0. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.network.neutron [req-297e264e-5660-462c-829a-e3d6b4ae628f req-0a6107c0-67cc-4851-ac6d-018247d65d64 service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Updating instance_info_cache with network_info: [{"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-297e264e-5660-462c-829a-e3d6b4ae628f req-0a6107c0-67cc-4851-ac6d-018247d65d64 service nova] Releasing lock "refresh_cache-16088b21-6f4c-4bb5-82e4-51946f015ffd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:40 user nova-compute[74587]: INFO os_vif [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=c1577f59-272d-4419-b256-d124fcc47d4f,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1577f59-27')
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:28:40 user nova-compute[74587]: INFO nova.compute.claims [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Claim successful on node user
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:28:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No VIF found with MAC fa:16:3e:42:5e:2f, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.network.neutron [req-df679dcc-dfa5-43d9-855a-1fd1dbe99e4c req-b2f35ae3-b5a5-4197-bc0d-6e4b41a6a8ab service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Updated VIF entry in instance network info cache for port c1577f59-272d-4419-b256-d124fcc47d4f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.network.neutron [req-df679dcc-dfa5-43d9-855a-1fd1dbe99e4c req-b2f35ae3-b5a5-4197-bc0d-6e4b41a6a8ab service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Updating instance_info_cache with network_info: [{"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-df679dcc-dfa5-43d9-855a-1fd1dbe99e4c req-b2f35ae3-b5a5-4197-bc0d-6e4b41a6a8ab service nova] Releasing lock "refresh_cache-31fa8ba1-a21e-43b9-9916-2e9245087107" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:28:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.policy [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f85bb012d6c490998c7dfd8dacf067d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744a2911afd9453380cc4a7fdd544d8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:28:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Creating image(s)
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Ensure instance console log exists: /opt/stack/data/nova/instances/3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Start _get_guest_xml network_info=[{"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '768ea152-763b-4fe5-948c-80c3e06270db', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQHxhPso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb77fe70-658d-4680-a2da-79b135918740', 'serial': 'fb77fe70-658d-4680-a2da-79b135918740'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:28:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQHxhPso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:28:41 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:28:41 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:28:41 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:28:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Creating image(s)
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "/opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "/opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc77f3fc-9621-4fe9-b247-f7663b2ac909]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:28:41 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2f45f3-45dd-414c-9513-b6330520cac7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740] added
Oct 18 07:28:41 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[631a1ed1-78b8-48ed-b169-a50e4d58b288]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3180e21c-37a0-49e7-ae44-1232821277ff]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQHxhPso {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQHxhPso" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9fb77c-9840-4f75-83cb-96c3b5ba61a5]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jQHxhPso'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.190s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.048s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[025cf61a-8c1f-4cc1-a29b-0d1ffb92a29b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f68d800-a177-4b28-a7ff-149a633178c8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:28:41 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:28:41 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:28:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[964f306d-f5e4-4655-b05f-909e3778833d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260]
Oct 18 07:28:42 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260] successful.
Oct 18 07:28:42 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3458ae-64d5-4d91-9b09-e73b9cc37cb3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb4b0b-5e4b-46d1-a5d2-3e018b6d47b3]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:28:42 user nova-compute[74587]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:28:42 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:28:42 user nova-compute[74587]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:28:42 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Successfully created port: 5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[325c2f08-91c1-48cc-a280-6f2f29daf705]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.242s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk 1073741824" returned: 0 in 0.061s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.209s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Cannot resize image /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Ensure instance console log exists: /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Successfully updated port: 5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Acquiring lock "refresh_cache-ba90228d-2d1f-436d-b169-9ef728328f35" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Acquired lock "refresh_cache-ba90228d-2d1f-436d-b169-9ef728328f35" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-7e663ee3-59a5-489b-8ae5-005ba76c4671 req-d64f1cba-b404-475e-a3ee-171dfe6bb925 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Received event network-changed-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-7e663ee3-59a5-489b-8ae5-005ba76c4671 req-d64f1cba-b404-475e-a3ee-171dfe6bb925 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Refreshing instance network info cache due to event network-changed-5d2a57dc-3e06-41f3-ba3d-24fdebcab987. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7e663ee3-59a5-489b-8ae5-005ba76c4671 req-d64f1cba-b404-475e-a3ee-171dfe6bb925 service nova] Acquiring lock "refresh_cache-ba90228d-2d1f-436d-b169-9ef728328f35" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:28:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQHxhPso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '26439373338656332', 'path': '/dev/sdc'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439373338656332', 'path': '/dev/sdc'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-852654026',display_name='tempest-TestVolumeBootPattern-server-852654026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-852654026',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrD4QGeTTaMlXZ8vfsMMfK6pzduYaYdY6TtuahCvtTSdq2mzozIo9GLQClLeKc4Krkj+ygZI/TyGPqsgnJukfJMz2PgqlnAY3XlyONEXn8OLnPP3EVD58CNxJh6K+Kl2g==',key_name='tempest-TestVolumeBootPattern-1340892382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-ximdadw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:22Z,user_data=None,user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=9226b6ed-6daa-43b7-805f-914e78250743,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9226b6ed-6d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.objects.instance [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.neutron [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Updating instance_info_cache with network_info: [{"id": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "address": "fa:16:3e:60:27:a2", "network": {"id": "19ef37c8-2359-4970-8965-aa7427eff4cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-522930903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "744a2911afd9453380cc4a7fdd544d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d2a57dc-3e", "ovs_interfaceid": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:28:43 user nova-compute[74587]:   <uuid>3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a</uuid>
Oct 18 07:28:43 user nova-compute[74587]:   <name>instance-00000021</name>
Oct 18 07:28:43 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:28:43 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:28:43 user nova-compute[74587]:   <metadata>
Oct 18 07:28:43 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:28:43 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:name>tempest-TestVolumeBootPattern-server-852654026</nova:name>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:28:41</nova:creationTime>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:28:43 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:28:43 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:owner>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:user uuid="d13de789e98e4ba9ad22d665ff8e4ddd">tempest-TestVolumeBootPattern-1301266373-project-member</nova:user>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:project uuid="f1cfa00773ba4c5498c56b84ccb307a9">tempest-TestVolumeBootPattern-1301266373</nova:project>
Oct 18 07:28:43 user nova-compute[74587]:       </nova:owner>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:ports>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:port uuid="9226b6ed-6daa-43b7-805f-914e78250743">
Oct 18 07:28:43 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 07:28:43 user nova-compute[74587]:         </nova:port>
Oct 18 07:28:43 user nova-compute[74587]:       </nova:ports>
Oct 18 07:28:43 user nova-compute[74587]:     </nova:instance>
Oct 18 07:28:43 user nova-compute[74587]:   </metadata>
Oct 18 07:28:43 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:28:43 user nova-compute[74587]:     <system>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="serial">3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a</entry>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="uuid">3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a</entry>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:28:43 user nova-compute[74587]:     </system>
Oct 18 07:28:43 user nova-compute[74587]:   </sysinfo>
Oct 18 07:28:43 user nova-compute[74587]:   <os>
Oct 18 07:28:43 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:28:43 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:28:43 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:28:43 user nova-compute[74587]:   </os>
Oct 18 07:28:43 user nova-compute[74587]:   <features>
Oct 18 07:28:43 user nova-compute[74587]:     <acpi/>
Oct 18 07:28:43 user nova-compute[74587]:     <apic/>
Oct 18 07:28:43 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:28:43 user nova-compute[74587]:   </features>
Oct 18 07:28:43 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:28:43 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:28:43 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:28:43 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:28:43 user nova-compute[74587]:   </clock>
Oct 18 07:28:43 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:28:43 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:28:43 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:28:43 user nova-compute[74587]:   </cpu>
Oct 18 07:28:43 user nova-compute[74587]:   <devices>
Oct 18 07:28:43 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:28:43 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:28:43 user nova-compute[74587]:       <source dev="/dev/sdc"/>
Oct 18 07:28:43 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:28:43 user nova-compute[74587]:       <serial>fb77fe70-658d-4680-a2da-79b135918740</serial>
Oct 18 07:28:43 user nova-compute[74587]:     </disk>
Oct 18 07:28:43 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:28:43 user nova-compute[74587]:       <mac address="fa:16:3e:90:31:f3"/>
Oct 18 07:28:43 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:28:43 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:28:43 user nova-compute[74587]:       <target dev="tap9226b6ed-6d"/>
Oct 18 07:28:43 user nova-compute[74587]:     </interface>
Oct 18 07:28:43 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:28:43 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a/console.log" append="off"/>
Oct 18 07:28:43 user nova-compute[74587]:     </serial>
Oct 18 07:28:43 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:28:43 user nova-compute[74587]:     <video>
Oct 18 07:28:43 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:28:43 user nova-compute[74587]:     </video>
Oct 18 07:28:43 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:28:43 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:28:43 user nova-compute[74587]:     </rng>
Oct 18 07:28:43 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:28:43 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:28:43 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:28:43 user nova-compute[74587]:     </memballoon>
Oct 18 07:28:43 user nova-compute[74587]:   </devices>
Oct 18 07:28:43 user nova-compute[74587]: </domain>
Oct 18 07:28:43 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-852654026',display_name='tempest-TestVolumeBootPattern-server-852654026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-852654026',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrD4QGeTTaMlXZ8vfsMMfK6pzduYaYdY6TtuahCvtTSdq2mzozIo9GLQClLeKc4Krkj+ygZI/TyGPqsgnJukfJMz2PgqlnAY3XlyONEXn8OLnPP3EVD58CNxJh6K+Kl2g==',key_name='tempest-TestVolumeBootPattern-1340892382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-ximdadw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:22Z,user_data=None,user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=9226b6ed-6daa-43b7-805f-914e78250743,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9226b6ed-6d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG os_vif [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=9226b6ed-6daa-43b7-805f-914e78250743,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9226b6ed-6d') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Releasing lock "refresh_cache-ba90228d-2d1f-436d-b169-9ef728328f35" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Instance network_info: |[{"id": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "address": "fa:16:3e:60:27:a2", "network": {"id": "19ef37c8-2359-4970-8965-aa7427eff4cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-522930903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "744a2911afd9453380cc4a7fdd544d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d2a57dc-3e", "ovs_interfaceid": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9da637c7-a911-5e6b-b06b-ff32d40bd3e6', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7e663ee3-59a5-489b-8ae5-005ba76c4671 req-d64f1cba-b404-475e-a3ee-171dfe6bb925 service nova] Acquired lock "refresh_cache-ba90228d-2d1f-436d-b169-9ef728328f35" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.neutron [req-7e663ee3-59a5-489b-8ae5-005ba76c4671 req-d64f1cba-b404-475e-a3ee-171dfe6bb925 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Refreshing network info cache for port 5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Start _get_guest_xml network_info=[{"id": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "address": "fa:16:3e:60:27:a2", "network": {"id": "19ef37c8-2359-4970-8965-aa7427eff4cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-522930903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "744a2911afd9453380cc4a7fdd544d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d2a57dc-3e", "ovs_interfaceid": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:43 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:43 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9226b6ed-6d, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9226b6ed-6d, col_values=(('qos', UUID('ede59392-f066-433e-b670-4536b97ed604')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9226b6ed-6d, col_values=(('external_ids', {'iface-id': '9226b6ed-6daa-43b7-805f-914e78250743', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:31:f3', 'vm-uuid': '3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1337550328',display_name='tempest-VolumesActionsTest-instance-1337550328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1337550328',id=36,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='744a2911afd9453380cc4a7fdd544d8c',ramdisk_id='',reservation_id='r-7zlgsv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-730034340',owner_user_name='tempest-VolumesActionsTest-730034340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:42Z,user_data=None,user_id='6f85bb012d6c490998c7dfd8dacf067d',uuid=ba90228d-2d1f-436d-b169-9ef728328f35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "address": "fa:16:3e:60:27:a2", "network": {"id": "19ef37c8-2359-4970-8965-aa7427eff4cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-522930903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "744a2911afd9453380cc4a7fdd544d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d2a57dc-3e", "ovs_interfaceid": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Converting VIF {"id": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "address": "fa:16:3e:60:27:a2", "network": {"id": "19ef37c8-2359-4970-8965-aa7427eff4cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-522930903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "744a2911afd9453380cc4a7fdd544d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d2a57dc-3e", "ovs_interfaceid": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:27:a2,bridge_name='br-int',has_traffic_filtering=True,id=5d2a57dc-3e06-41f3-ba3d-24fdebcab987,network=Network(19ef37c8-2359-4970-8965-aa7427eff4cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d2a57dc-3e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.objects.instance [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lazy-loading 'pci_devices' on Instance uuid ba90228d-2d1f-436d-b169-9ef728328f35 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: INFO os_vif [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=9226b6ed-6daa-43b7-805f-914e78250743,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9226b6ed-6d')
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:28:43 user nova-compute[74587]:   <uuid>ba90228d-2d1f-436d-b169-9ef728328f35</uuid>
Oct 18 07:28:43 user nova-compute[74587]:   <name>instance-00000024</name>
Oct 18 07:28:43 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:28:43 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:28:43 user nova-compute[74587]:   <metadata>
Oct 18 07:28:43 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:28:43 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:name>tempest-VolumesActionsTest-instance-1337550328</nova:name>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:28:43</nova:creationTime>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:28:43 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:28:43 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:owner>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:user uuid="6f85bb012d6c490998c7dfd8dacf067d">tempest-VolumesActionsTest-730034340-project-member</nova:user>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:project uuid="744a2911afd9453380cc4a7fdd544d8c">tempest-VolumesActionsTest-730034340</nova:project>
Oct 18 07:28:43 user nova-compute[74587]:       </nova:owner>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:28:43 user nova-compute[74587]:       <nova:ports>
Oct 18 07:28:43 user nova-compute[74587]:         <nova:port uuid="5d2a57dc-3e06-41f3-ba3d-24fdebcab987">
Oct 18 07:28:43 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 07:28:43 user nova-compute[74587]:         </nova:port>
Oct 18 07:28:43 user nova-compute[74587]:       </nova:ports>
Oct 18 07:28:43 user nova-compute[74587]:     </nova:instance>
Oct 18 07:28:43 user nova-compute[74587]:   </metadata>
Oct 18 07:28:43 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:28:43 user nova-compute[74587]:     <system>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="serial">ba90228d-2d1f-436d-b169-9ef728328f35</entry>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="uuid">ba90228d-2d1f-436d-b169-9ef728328f35</entry>
Oct 18 07:28:43 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:28:43 user nova-compute[74587]:     </system>
Oct 18 07:28:43 user nova-compute[74587]:   </sysinfo>
Oct 18 07:28:43 user nova-compute[74587]:   <os>
Oct 18 07:28:43 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:28:43 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:28:43 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:28:43 user nova-compute[74587]:   </os>
Oct 18 07:28:43 user nova-compute[74587]:   <features>
Oct 18 07:28:43 user nova-compute[74587]:     <acpi/>
Oct 18 07:28:43 user nova-compute[74587]:     <apic/>
Oct 18 07:28:43 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:28:43 user nova-compute[74587]:   </features>
Oct 18 07:28:43 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:28:43 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:28:43 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:28:43 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:28:43 user nova-compute[74587]:   </clock>
Oct 18 07:28:43 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:28:43 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:28:43 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:28:43 user nova-compute[74587]:   </cpu>
Oct 18 07:28:43 user nova-compute[74587]:   <devices>
Oct 18 07:28:43 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:28:43 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:28:43 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk"/>
Oct 18 07:28:43 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:28:43 user nova-compute[74587]:     </disk>
Oct 18 07:28:43 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:28:43 user nova-compute[74587]:       <mac address="fa:16:3e:60:27:a2"/>
Oct 18 07:28:43 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:28:43 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:28:43 user nova-compute[74587]:       <target dev="tap5d2a57dc-3e"/>
Oct 18 07:28:43 user nova-compute[74587]:     </interface>
Oct 18 07:28:43 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:28:43 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/console.log" append="off"/>
Oct 18 07:28:43 user nova-compute[74587]:     </serial>
Oct 18 07:28:43 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:28:43 user nova-compute[74587]:     <video>
Oct 18 07:28:43 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:28:43 user nova-compute[74587]:     </video>
Oct 18 07:28:43 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:28:43 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:28:43 user nova-compute[74587]:     </rng>
Oct 18 07:28:43 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:28:43 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:28:43 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:28:43 user nova-compute[74587]:     </memballoon>
Oct 18 07:28:43 user nova-compute[74587]:   </devices>
Oct 18 07:28:43 user nova-compute[74587]: </domain>
Oct 18 07:28:43 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1337550328',display_name='tempest-VolumesActionsTest-instance-1337550328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1337550328',id=36,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='744a2911afd9453380cc4a7fdd544d8c',ramdisk_id='',reservation_id='r-7zlgsv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-730034340',owner_user_name='tempest-VolumesActionsTest-730034340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:28:42Z,user_data=None,user_id='6f85bb012d6c490998c7dfd8dacf067d',uuid=ba90228d-2d1f-436d-b169-9ef728328f35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "address": "fa:16:3e:60:27:a2", "network": {"id": "19ef37c8-2359-4970-8965-aa7427eff4cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-522930903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "744a2911afd9453380cc4a7fdd544d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d2a57dc-3e", "ovs_interfaceid": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Converting VIF {"id": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "address": "fa:16:3e:60:27:a2", "network": {"id": "19ef37c8-2359-4970-8965-aa7427eff4cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-522930903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "744a2911afd9453380cc4a7fdd544d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d2a57dc-3e", "ovs_interfaceid": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:27:a2,bridge_name='br-int',has_traffic_filtering=True,id=5d2a57dc-3e06-41f3-ba3d-24fdebcab987,network=Network(19ef37c8-2359-4970-8965-aa7427eff4cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d2a57dc-3e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG os_vif [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:27:a2,bridge_name='br-int',has_traffic_filtering=True,id=5d2a57dc-3e06-41f3-ba3d-24fdebcab987,network=Network(19ef37c8-2359-4970-8965-aa7427eff4cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d2a57dc-3e') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb639e96-1db8-5525-9089-68d94c17fc66', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d2a57dc-3e, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d2a57dc-3e, col_values=(('qos', UUID('0ca13971-f492-4f65-bbe8-0f1cb254bdf0')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d2a57dc-3e, col_values=(('external_ids', {'iface-id': '5d2a57dc-3e06-41f3-ba3d-24fdebcab987', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:27:a2', 'vm-uuid': 'ba90228d-2d1f-436d-b169-9ef728328f35'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] No VIF found with MAC fa:16:3e:90:31:f3, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: INFO os_vif [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:27:a2,bridge_name='br-int',has_traffic_filtering=True,id=5d2a57dc-3e06-41f3-ba3d-24fdebcab987,network=Network(19ef37c8-2359-4970-8965-aa7427eff4cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d2a57dc-3e')
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] No VIF found with MAC fa:16:3e:60:27:a2, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.neutron [req-7e663ee3-59a5-489b-8ae5-005ba76c4671 req-d64f1cba-b404-475e-a3ee-171dfe6bb925 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Updated VIF entry in instance network info cache for port 5d2a57dc-3e06-41f3-ba3d-24fdebcab987. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG nova.network.neutron [req-7e663ee3-59a5-489b-8ae5-005ba76c4671 req-d64f1cba-b404-475e-a3ee-171dfe6bb925 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Updating instance_info_cache with network_info: [{"id": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "address": "fa:16:3e:60:27:a2", "network": {"id": "19ef37c8-2359-4970-8965-aa7427eff4cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-522930903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "744a2911afd9453380cc4a7fdd544d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d2a57dc-3e", "ovs_interfaceid": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7e663ee3-59a5-489b-8ae5-005ba76c4671 req-d64f1cba-b404-475e-a3ee-171dfe6bb925 service nova] Releasing lock "refresh_cache-ba90228d-2d1f-436d-b169-9ef728328f35" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-f4a8118b-321e-4bd0-ba44-66ac6dea6680 req-33939967-6671-4f61-943a-ec724fdda070 service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received event network-vif-plugged-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f4a8118b-321e-4bd0-ba44-66ac6dea6680 req-33939967-6671-4f61-943a-ec724fdda070 service nova] Acquiring lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f4a8118b-321e-4bd0-ba44-66ac6dea6680 req-33939967-6671-4f61-943a-ec724fdda070 service nova] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f4a8118b-321e-4bd0-ba44-66ac6dea6680 req-33939967-6671-4f61-943a-ec724fdda070 service nova] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-f4a8118b-321e-4bd0-ba44-66ac6dea6680 req-33939967-6671-4f61-943a-ec724fdda070 service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] No waiting events found dispatching network-vif-plugged-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:44 user nova-compute[74587]: WARNING nova.compute.manager [req-f4a8118b-321e-4bd0-ba44-66ac6dea6680 req-33939967-6671-4f61-943a-ec724fdda070 service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received unexpected event network-vif-plugged-c1577f59-272d-4419-b256-d124fcc47d4f for instance with vm_state building and task_state spawning.
Oct 18 07:28:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-4b2eb373-d52f-427f-bd8d-8dbe3f502811 req-d8df720d-27a4-48ce-869f-37459faeb55d service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received event network-vif-plugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4b2eb373-d52f-427f-bd8d-8dbe3f502811 req-d8df720d-27a4-48ce-869f-37459faeb55d service nova] Acquiring lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4b2eb373-d52f-427f-bd8d-8dbe3f502811 req-d8df720d-27a4-48ce-869f-37459faeb55d service nova] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4b2eb373-d52f-427f-bd8d-8dbe3f502811 req-d8df720d-27a4-48ce-869f-37459faeb55d service nova] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-4b2eb373-d52f-427f-bd8d-8dbe3f502811 req-d8df720d-27a4-48ce-869f-37459faeb55d service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] No waiting events found dispatching network-vif-plugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:44 user nova-compute[74587]: WARNING nova.compute.manager [req-4b2eb373-d52f-427f-bd8d-8dbe3f502811 req-d8df720d-27a4-48ce-869f-37459faeb55d service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received unexpected event network-vif-plugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 for instance with vm_state building and task_state spawning.
Oct 18 07:28:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-e07d1119-1a81-46fe-a276-cab5bae140a6 req-c98aaa36-1a71-4c13-bb30-0ae5a83f4b43 service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received event network-vif-plugged-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e07d1119-1a81-46fe-a276-cab5bae140a6 req-c98aaa36-1a71-4c13-bb30-0ae5a83f4b43 service nova] Acquiring lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e07d1119-1a81-46fe-a276-cab5bae140a6 req-c98aaa36-1a71-4c13-bb30-0ae5a83f4b43 service nova] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e07d1119-1a81-46fe-a276-cab5bae140a6 req-c98aaa36-1a71-4c13-bb30-0ae5a83f4b43 service nova] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-e07d1119-1a81-46fe-a276-cab5bae140a6 req-c98aaa36-1a71-4c13-bb30-0ae5a83f4b43 service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] No waiting events found dispatching network-vif-plugged-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:46 user nova-compute[74587]: WARNING nova.compute.manager [req-e07d1119-1a81-46fe-a276-cab5bae140a6 req-c98aaa36-1a71-4c13-bb30-0ae5a83f4b43 service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received unexpected event network-vif-plugged-c1577f59-272d-4419-b256-d124fcc47d4f for instance with vm_state building and task_state spawning.
Oct 18 07:28:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-731c04c6-cf13-4076-8d9c-c929d9f9ead3 req-cae4dffc-4538-40f4-8a85-cff492b8826e service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received event network-vif-plugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-731c04c6-cf13-4076-8d9c-c929d9f9ead3 req-cae4dffc-4538-40f4-8a85-cff492b8826e service nova] Acquiring lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-731c04c6-cf13-4076-8d9c-c929d9f9ead3 req-cae4dffc-4538-40f4-8a85-cff492b8826e service nova] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-731c04c6-cf13-4076-8d9c-c929d9f9ead3 req-cae4dffc-4538-40f4-8a85-cff492b8826e service nova] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:46 user nova-compute[74587]: DEBUG nova.compute.manager [req-731c04c6-cf13-4076-8d9c-c929d9f9ead3 req-cae4dffc-4538-40f4-8a85-cff492b8826e service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] No waiting events found dispatching network-vif-plugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:46 user nova-compute[74587]: WARNING nova.compute.manager [req-731c04c6-cf13-4076-8d9c-c929d9f9ead3 req-cae4dffc-4538-40f4-8a85-cff492b8826e service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received unexpected event network-vif-plugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 for instance with vm_state building and task_state spawning.
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG nova.compute.manager [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:28:47 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: bb153556-57ca-4401-894a-e3588a05e460] Instance running successfully.
Oct 18 07:28:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Failed to set time: agent not configured {{(pid=74587) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 18 07:28:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8bd4e2fc-c2ff-428e-816f-0839bba67325 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] finish_migration finished successfully. {{(pid=74587) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received event network-vif-plugged-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] Acquiring lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] No waiting events found dispatching network-vif-plugged-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:48 user nova-compute[74587]: WARNING nova.compute.manager [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received unexpected event network-vif-plugged-9226b6ed-6daa-43b7-805f-914e78250743 for instance with vm_state building and task_state spawning.
Oct 18 07:28:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received event network-vif-plugged-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] Acquiring lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] No waiting events found dispatching network-vif-plugged-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:48 user nova-compute[74587]: WARNING nova.compute.manager [req-c3c815d3-b232-4eac-ba38-5f7e3956d13c req-ba0e96b7-5367-4987-a485-adc05202dd73 service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received unexpected event network-vif-plugged-9226b6ed-6daa-43b7-805f-914e78250743 for instance with vm_state building and task_state spawning.
Oct 18 07:28:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:28:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:28:49 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Instance spawned successfully.
Oct 18 07:28:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:28:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:49 user nova-compute[74587]: INFO nova.compute.manager [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Took 11.57 seconds to spawn the instance on the hypervisor.
Oct 18 07:28:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:28:49 user nova-compute[74587]: INFO nova.compute.manager [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Took 12.77 seconds to build instance.
Oct 18 07:28:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e53da340-46e1-4f75-bbb8-856e4d823ced tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.913s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-0dffa430-5f02-4c97-8bed-6388e54a4b10 req-e8f16919-92c4-4e94-9c9b-b09fb2495919 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0dffa430-5f02-4c97-8bed-6388e54a4b10 req-e8f16919-92c4-4e94-9c9b-b09fb2495919 service nova] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0dffa430-5f02-4c97-8bed-6388e54a4b10 req-e8f16919-92c4-4e94-9c9b-b09fb2495919 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0dffa430-5f02-4c97-8bed-6388e54a4b10 req-e8f16919-92c4-4e94-9c9b-b09fb2495919 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-0dffa430-5f02-4c97-8bed-6388e54a4b10 req-e8f16919-92c4-4e94-9c9b-b09fb2495919 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] No waiting events found dispatching network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:50 user nova-compute[74587]: WARNING nova.compute.manager [req-0dffa430-5f02-4c97-8bed-6388e54a4b10 req-e8f16919-92c4-4e94-9c9b-b09fb2495919 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received unexpected event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa for instance with vm_state resized and task_state None.
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:28:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Instance spawned successfully.
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:28:50 user nova-compute[74587]: INFO nova.compute.manager [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Took 8.75 seconds to spawn the instance on the hypervisor.
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:28:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Instance spawned successfully.
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:28:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Instance spawned successfully.
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:28:50 user nova-compute[74587]: INFO nova.compute.manager [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Took 9.83 seconds to build instance.
Oct 18 07:28:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ecd08cdf-d17b-4ebe-83c2-548860672e11 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "ba90228d-2d1f-436d-b169-9ef728328f35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.956s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:50 user nova-compute[74587]: INFO nova.compute.manager [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Took 14.35 seconds to spawn the instance on the hypervisor.
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:28:50 user nova-compute[74587]: INFO nova.compute.manager [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Took 9.01 seconds to spawn the instance on the hypervisor.
Oct 18 07:28:50 user nova-compute[74587]: DEBUG nova.compute.manager [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:28:50 user nova-compute[74587]: INFO nova.compute.manager [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Took 28.86 seconds to build instance.
Oct 18 07:28:50 user nova-compute[74587]: INFO nova.compute.manager [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Took 15.22 seconds to build instance.
Oct 18 07:28:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-186260f4-0c8f-425b-bc68-f331c4a2d4f9 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.970s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0a827d86-0955-4f4c-9a6d-90ffa82fbdd0 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.360s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] No waiting events found dispatching network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:52 user nova-compute[74587]: WARNING nova.compute.manager [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received unexpected event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa for instance with vm_state resized and task_state None.
Oct 18 07:28:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Received event network-vif-plugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] Acquiring lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] Lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] Lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] No waiting events found dispatching network-vif-plugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:52 user nova-compute[74587]: WARNING nova.compute.manager [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Received unexpected event network-vif-plugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 for instance with vm_state active and task_state None.
Oct 18 07:28:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Received event network-vif-plugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] Acquiring lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] Lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] Lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:28:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] No waiting events found dispatching network-vif-plugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:28:52 user nova-compute[74587]: WARNING nova.compute.manager [req-b1a9836d-c7ea-4e6d-b1e6-c2c7f4f2597c req-8b2936c5-b43a-4399-bc60-0e62e878aed1 service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Received unexpected event network-vif-plugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 for instance with vm_state active and task_state None.
Oct 18 07:28:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:28:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:17 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:29:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:29:18 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:29:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:29:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:29:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:29:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:29:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:29:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:29:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:29:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:29:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:29 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:29:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:29:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "7df5792a-005a-49b9-856f-7758869917fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:29:29 user nova-compute[74587]: DEBUG nova.compute.manager [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:29:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:29:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:29:29 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:29:29 user nova-compute[74587]: INFO nova.compute.claims [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Claim successful on node user
Oct 18 07:29:30 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG nova.network.neutron [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:29:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:29:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:29:30 user nova-compute[74587]: INFO nova.virt.block_device [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Booting with volume e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 at /dev/vda
Oct 18 07:29:30 user nova-compute[74587]: DEBUG nova.policy [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7c61f0efc8d462bb809d0f512914342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341d61f7861f48899f85601e632ed912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG os_brick.utils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2d8cfa-e3f1-4ae7-b103-7f41b9edeee8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cf48ad-4a1e-4a1b-9e76-e95a10aa0dad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e980f866-3d8c-4c18-b3fe-472f607ce353]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[597efc05-7561-441d-b099-f205c02bf31d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:29:30 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:29:30 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cacca5f-7b6a-4541-8681-1f1960118319]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG os_brick.utils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:29:30 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating existing volume attachment record: d96ac6cc-65f6-4f3e-879c-7ac1adb50382 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG nova.network.neutron [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Successfully created port: 2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG nova.network.neutron [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Successfully updated port: 2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-a73b9276-072d-42a8-8e2c-e5d770244e0c req-b5eff0f2-8360-4fef-bd92-de79753114ad service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-changed-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-a73b9276-072d-42a8-8e2c-e5d770244e0c req-b5eff0f2-8360-4fef-bd92-de79753114ad service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Refreshing instance network info cache due to event network-changed-2b4a587e-fda7-4b59-9074-241c0cbfe1d9. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a73b9276-072d-42a8-8e2c-e5d770244e0c req-b5eff0f2-8360-4fef-bd92-de79753114ad service nova] Acquiring lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a73b9276-072d-42a8-8e2c-e5d770244e0c req-b5eff0f2-8360-4fef-bd92-de79753114ad service nova] Acquired lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG nova.network.neutron [req-a73b9276-072d-42a8-8e2c-e5d770244e0c req-b5eff0f2-8360-4fef-bd92-de79753114ad service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Refreshing network info cache for port 2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG nova.network.neutron [req-a73b9276-072d-42a8-8e2c-e5d770244e0c req-b5eff0f2-8360-4fef-bd92-de79753114ad service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:31 user nova-compute[74587]: DEBUG nova.network.neutron [req-a73b9276-072d-42a8-8e2c-e5d770244e0c req-b5eff0f2-8360-4fef-bd92-de79753114ad service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a73b9276-072d-42a8-8e2c-e5d770244e0c req-b5eff0f2-8360-4fef-bd92-de79753114ad service nova] Releasing lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquired lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG nova.network.neutron [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG nova.network.neutron [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG nova.network.neutron [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating instance_info_cache with network_info: [{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Releasing lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG nova.compute.manager [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance network_info: |[{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:29:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:33 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:29:33 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:29:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7721MB free_disk=25.23093032836914GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:29:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:29:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:29:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Applying migration context for instance bb153556-57ca-4401-894a-e3588a05e460 as it has an incoming, in-progress migration a3558a2f-d9db-44c1-9fcb-82025fd3c969. Migration status is finished {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 18 07:29:34 user nova-compute[74587]: INFO nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating resource usage from migration a3558a2f-d9db-44c1-9fcb-82025fd3c969
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 665a2f6d-4704-400e-aeca-ae8cb29333da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Migration a3558a2f-d9db-44c1-9fcb-82025fd3c969 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance bb153556-57ca-4401-894a-e3588a05e460 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 16088b21-6f4c-4bb5-82e4-51946f015ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 31fa8ba1-a21e-43b9-9916-2e9245087107 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ba90228d-2d1f-436d-b169-9ef728328f35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 7df5792a-005a-49b9-856f-7758869917fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:29:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:29:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.compute.manager [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:29:47 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Creating image(s)
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Ensure instance console log exists: /opt/stack/data/nova/instances/7df5792a-005a-49b9-856f-7758869917fd/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Start _get_guest_xml network_info=[{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd96ac6cc-65f6-4f3e-879c-7ac1adb50382', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcYKVTFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7df5792a-005a-49b9-856f-7758869917fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 'serial': 'e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:29:47 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:29:47 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcYKVTFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:29:47 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:29:47 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:29:47 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1894c2-8e4f-4888-9b66-06c5f70279a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:29:47 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde9896-ca1d-4675-a244-9963cab669bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59] added
Oct 18 07:29:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b98b006-3332-480c-acab-a9aee322f3e3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bfedd0-82b3-4a92-8c92-beab948a44e0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcYKVTFj {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcYKVTFj" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff17fb4-e4f5-489f-ad83-c08752a8dcae]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qcYKVTFj'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f7efc-cac0-45bf-a843-2ca542ef3801]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[170a32ed-e565-4db3-8361-2ac0cecbc2bb]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:29:47 user nova-compute[74587]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:29:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:29:47 user nova-compute[74587]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:29:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c76f58a-b12b-4833-8b5e-3000bb4a6522]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260]
Oct 18 07:29:47 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260] successful.
Oct 18 07:29:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d100c427-2a69-41db-9056-96b8e344b967]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c419ed47-c79d-4109-bb17-06917554b3a1]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:29:47 user nova-compute[74587]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:29:47 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:29:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:29:47 user nova-compute[74587]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:29:47 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:29:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e24610e-53cb-42c1-ba09-722c8dfbbef6]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:29:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcYKVTFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26138303030346233', 'path': '/dev/sdd'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138303030346233', 'path': '/dev/sdd'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-283849704',display_name='tempest-TestShelveInstance-server-283849704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-283849704',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkABgU+Vcpq23Lp+OOTXqH5YIc95x7QJ6Mj8W3S09rlS/ucKS/KicjYv0xrTlTUuMuVyT5n13nN5l7SLjfOW4c+gXg636Eb6UmCQPbB++Ff6O/AJNy0ajwcVkUyhrnkGg==',key_name='tempest-TestShelveInstance-262530121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='341d61f7861f48899f85601e632ed912',ramdisk_id='',reservation_id='r-0u9l9p27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-906083640',owner_user_name='tempest-TestShelveInstance-906083640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:29:30Z,user_data=None,user_id='f7c61f0efc8d462bb809d0f512914342',uuid=7df5792a-005a-49b9-856f-7758869917fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converting VIF {"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.objects.instance [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lazy-loading 'pci_devices' on Instance uuid 7df5792a-005a-49b9-856f-7758869917fd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:29:48 user nova-compute[74587]:   <uuid>7df5792a-005a-49b9-856f-7758869917fd</uuid>
Oct 18 07:29:48 user nova-compute[74587]:   <name>instance-00000025</name>
Oct 18 07:29:48 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:29:48 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:29:48 user nova-compute[74587]:   <metadata>
Oct 18 07:29:48 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:29:48 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:29:48 user nova-compute[74587]:       <nova:name>tempest-TestShelveInstance-server-283849704</nova:name>
Oct 18 07:29:48 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:29:47</nova:creationTime>
Oct 18 07:29:48 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:29:48 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:29:48 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:29:48 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:29:48 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:29:48 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:29:48 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:29:48 user nova-compute[74587]:       <nova:owner>
Oct 18 07:29:48 user nova-compute[74587]:         <nova:user uuid="f7c61f0efc8d462bb809d0f512914342">tempest-TestShelveInstance-906083640-project-member</nova:user>
Oct 18 07:29:48 user nova-compute[74587]:         <nova:project uuid="341d61f7861f48899f85601e632ed912">tempest-TestShelveInstance-906083640</nova:project>
Oct 18 07:29:48 user nova-compute[74587]:       </nova:owner>
Oct 18 07:29:48 user nova-compute[74587]:       <nova:ports>
Oct 18 07:29:48 user nova-compute[74587]:         <nova:port uuid="2b4a587e-fda7-4b59-9074-241c0cbfe1d9">
Oct 18 07:29:48 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 07:29:48 user nova-compute[74587]:         </nova:port>
Oct 18 07:29:48 user nova-compute[74587]:       </nova:ports>
Oct 18 07:29:48 user nova-compute[74587]:     </nova:instance>
Oct 18 07:29:48 user nova-compute[74587]:   </metadata>
Oct 18 07:29:48 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:29:48 user nova-compute[74587]:     <system>
Oct 18 07:29:48 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:29:48 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:29:48 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:29:48 user nova-compute[74587]:       <entry name="serial">7df5792a-005a-49b9-856f-7758869917fd</entry>
Oct 18 07:29:48 user nova-compute[74587]:       <entry name="uuid">7df5792a-005a-49b9-856f-7758869917fd</entry>
Oct 18 07:29:48 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:29:48 user nova-compute[74587]:     </system>
Oct 18 07:29:48 user nova-compute[74587]:   </sysinfo>
Oct 18 07:29:48 user nova-compute[74587]:   <os>
Oct 18 07:29:48 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:29:48 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:29:48 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:29:48 user nova-compute[74587]:   </os>
Oct 18 07:29:48 user nova-compute[74587]:   <features>
Oct 18 07:29:48 user nova-compute[74587]:     <acpi/>
Oct 18 07:29:48 user nova-compute[74587]:     <apic/>
Oct 18 07:29:48 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:29:48 user nova-compute[74587]:   </features>
Oct 18 07:29:48 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:29:48 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:29:48 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:29:48 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:29:48 user nova-compute[74587]:   </clock>
Oct 18 07:29:48 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:29:48 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:29:48 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:29:48 user nova-compute[74587]:   </cpu>
Oct 18 07:29:48 user nova-compute[74587]:   <devices>
Oct 18 07:29:48 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:29:48 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:29:48 user nova-compute[74587]:       <source dev="/dev/sdd"/>
Oct 18 07:29:48 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:29:48 user nova-compute[74587]:       <serial>e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59</serial>
Oct 18 07:29:48 user nova-compute[74587]:     </disk>
Oct 18 07:29:48 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:29:48 user nova-compute[74587]:       <mac address="fa:16:3e:8e:48:35"/>
Oct 18 07:29:48 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:29:48 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:29:48 user nova-compute[74587]:       <target dev="tap2b4a587e-fd"/>
Oct 18 07:29:48 user nova-compute[74587]:     </interface>
Oct 18 07:29:48 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:29:48 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/7df5792a-005a-49b9-856f-7758869917fd/console.log" append="off"/>
Oct 18 07:29:48 user nova-compute[74587]:     </serial>
Oct 18 07:29:48 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:29:48 user nova-compute[74587]:     <video>
Oct 18 07:29:48 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:29:48 user nova-compute[74587]:     </video>
Oct 18 07:29:48 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:29:48 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:29:48 user nova-compute[74587]:     </rng>
Oct 18 07:29:48 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:29:48 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:29:48 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:29:48 user nova-compute[74587]:     </memballoon>
Oct 18 07:29:48 user nova-compute[74587]:   </devices>
Oct 18 07:29:48 user nova-compute[74587]: </domain>
Oct 18 07:29:48 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-283849704',display_name='tempest-TestShelveInstance-server-283849704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-283849704',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkABgU+Vcpq23Lp+OOTXqH5YIc95x7QJ6Mj8W3S09rlS/ucKS/KicjYv0xrTlTUuMuVyT5n13nN5l7SLjfOW4c+gXg636Eb6UmCQPbB++Ff6O/AJNy0ajwcVkUyhrnkGg==',key_name='tempest-TestShelveInstance-262530121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='341d61f7861f48899f85601e632ed912',ramdisk_id='',reservation_id='r-0u9l9p27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-906083640',owner_user_name='tempest-TestShelveInstance-906083640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:29:30Z,user_data=None,user_id='f7c61f0efc8d462bb809d0f512914342',uuid=7df5792a-005a-49b9-856f-7758869917fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converting VIF {"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG os_vif [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f97c2eb5-f94e-536e-8f95-ac918c9bfe52', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b4a587e-fd, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b4a587e-fd, col_values=(('qos', UUID('994e43a2-5a1f-4047-868f-b694b65f0848')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b4a587e-fd, col_values=(('external_ids', {'iface-id': '2b4a587e-fda7-4b59-9074-241c0cbfe1d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:48:35', 'vm-uuid': '7df5792a-005a-49b9-856f-7758869917fd'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:48 user nova-compute[74587]: INFO os_vif [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd')
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:29:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] No VIF found with MAC fa:16:3e:8e:48:35, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:29:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-98dcde15-37dc-4e55-ad03-98c523c4fd96 req-90edcbeb-5618-44fe-a6d7-2403e8a1f69a service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:29:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-98dcde15-37dc-4e55-ad03-98c523c4fd96 req-90edcbeb-5618-44fe-a6d7-2403e8a1f69a service nova] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:29:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-98dcde15-37dc-4e55-ad03-98c523c4fd96 req-90edcbeb-5618-44fe-a6d7-2403e8a1f69a service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:29:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-98dcde15-37dc-4e55-ad03-98c523c4fd96 req-90edcbeb-5618-44fe-a6d7-2403e8a1f69a service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:29:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-98dcde15-37dc-4e55-ad03-98c523c4fd96 req-90edcbeb-5618-44fe-a6d7-2403e8a1f69a service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] No waiting events found dispatching network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:29:50 user nova-compute[74587]: WARNING nova.compute.manager [req-98dcde15-37dc-4e55-ad03-98c523c4fd96 req-90edcbeb-5618-44fe-a6d7-2403e8a1f69a service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received unexpected event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 for instance with vm_state building and task_state spawning.
Oct 18 07:29:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:29:52 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance spawned successfully.
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-a32aa96f-c294-47d0-9e18-28af31040efb req-761f5817-d83b-4171-a471-e09cade46716 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a32aa96f-c294-47d0-9e18-28af31040efb req-761f5817-d83b-4171-a471-e09cade46716 service nova] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a32aa96f-c294-47d0-9e18-28af31040efb req-761f5817-d83b-4171-a471-e09cade46716 service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a32aa96f-c294-47d0-9e18-28af31040efb req-761f5817-d83b-4171-a471-e09cade46716 service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-a32aa96f-c294-47d0-9e18-28af31040efb req-761f5817-d83b-4171-a471-e09cade46716 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] No waiting events found dispatching network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:29:52 user nova-compute[74587]: WARNING nova.compute.manager [req-a32aa96f-c294-47d0-9e18-28af31040efb req-761f5817-d83b-4171-a471-e09cade46716 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received unexpected event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 for instance with vm_state building and task_state spawning.
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:29:52 user nova-compute[74587]: INFO nova.compute.manager [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 18 07:29:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:29:52 user nova-compute[74587]: INFO nova.compute.manager [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Took 22.89 seconds to build instance.
Oct 18 07:29:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-beb1b4d2-009f-42df-a92c-38eb03aa3521 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "7df5792a-005a-49b9-856f-7758869917fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.985s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:29:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:29:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "bb153556-57ca-4401-894a-e3588a05e460" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Going to confirm migration 2 {{(pid=74587) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 18 07:30:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:30:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquired lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:30:04 user nova-compute[74587]: DEBUG nova.network.neutron [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:30:04 user nova-compute[74587]: DEBUG nova.objects.instance [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'info_cache' on Instance uuid bb153556-57ca-4401-894a-e3588a05e460 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:30:05 user nova-compute[74587]: DEBUG nova.network.neutron [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating instance_info_cache with network_info: [{"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:30:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Releasing lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:30:05 user nova-compute[74587]: DEBUG nova.objects.instance [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'migration_context' on Instance uuid bb153556-57ca-4401-894a-e3588a05e460 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:30:05 user nova-compute[74587]: DEBUG nova.objects.base [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Object Instance<bb153556-57ca-4401-894a-e3588a05e460> lazy-loaded attributes: info_cache,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:30:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:05 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:30:05 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:30:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.580s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:06 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Deleted allocation for migration a3558a2f-d9db-44c1-9fcb-82025fd3c969
Oct 18 07:30:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-04c3176b-51ae-4191-a491-e401b46fe236 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "bb153556-57ca-4401-894a-e3588a05e460" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.694s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-4b776d77-4528-481b-9c60-46d427021f67 req-bd25ba69-49f2-4e11-b21a-7f3532fc0f7c service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received event network-changed-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-4b776d77-4528-481b-9c60-46d427021f67 req-bd25ba69-49f2-4e11-b21a-7f3532fc0f7c service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Refreshing instance network info cache due to event network-changed-9226b6ed-6daa-43b7-805f-914e78250743. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4b776d77-4528-481b-9c60-46d427021f67 req-bd25ba69-49f2-4e11-b21a-7f3532fc0f7c service nova] Acquiring lock "refresh_cache-3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4b776d77-4528-481b-9c60-46d427021f67 req-bd25ba69-49f2-4e11-b21a-7f3532fc0f7c service nova] Acquired lock "refresh_cache-3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-4b776d77-4528-481b-9c60-46d427021f67 req-bd25ba69-49f2-4e11-b21a-7f3532fc0f7c service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Refreshing network info cache for port 9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-4b776d77-4528-481b-9c60-46d427021f67 req-bd25ba69-49f2-4e11-b21a-7f3532fc0f7c service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Updated VIF entry in instance network info cache for port 9226b6ed-6daa-43b7-805f-914e78250743. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG nova.network.neutron [req-4b776d77-4528-481b-9c60-46d427021f67 req-bd25ba69-49f2-4e11-b21a-7f3532fc0f7c service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Updating instance_info_cache with network_info: [{"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4b776d77-4528-481b-9c60-46d427021f67 req-bd25ba69-49f2-4e11-b21a-7f3532fc0f7c service nova] Releasing lock "refresh_cache-3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:14 user nova-compute[74587]: INFO nova.compute.manager [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Terminating instance
Oct 18 07:30:14 user nova-compute[74587]: DEBUG nova.compute.manager [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-4fa68217-1e1b-4f26-852f-5300538a990b req-b952efca-6e07-42fe-88da-a4499447e47c service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received event network-vif-unplugged-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4fa68217-1e1b-4f26-852f-5300538a990b req-b952efca-6e07-42fe-88da-a4499447e47c service nova] Acquiring lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4fa68217-1e1b-4f26-852f-5300538a990b req-b952efca-6e07-42fe-88da-a4499447e47c service nova] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4fa68217-1e1b-4f26-852f-5300538a990b req-b952efca-6e07-42fe-88da-a4499447e47c service nova] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-4fa68217-1e1b-4f26-852f-5300538a990b req-b952efca-6e07-42fe-88da-a4499447e47c service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] No waiting events found dispatching network-vif-unplugged-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:30:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-4fa68217-1e1b-4f26-852f-5300538a990b req-b952efca-6e07-42fe-88da-a4499447e47c service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received event network-vif-unplugged-9226b6ed-6daa-43b7-805f-914e78250743 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Instance destroyed successfully.
Oct 18 07:30:15 user nova-compute[74587]: DEBUG nova.objects.instance [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lazy-loading 'resources' on Instance uuid 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-852654026',display_name='tempest-TestVolumeBootPattern-server-852654026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-852654026',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrD4QGeTTaMlXZ8vfsMMfK6pzduYaYdY6TtuahCvtTSdq2mzozIo9GLQClLeKc4Krkj+ygZI/TyGPqsgnJukfJMz2PgqlnAY3XlyONEXn8OLnPP3EVD58CNxJh6K+Kl2g==',key_name='tempest-TestVolumeBootPattern-1340892382',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:28:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-ximdadw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:28:51Z,user_data=None,user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "9226b6ed-6daa-43b7-805f-914e78250743", "address": "fa:16:3e:90:31:f3", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9226b6ed-6d", "ovs_interfaceid": "9226b6ed-6daa-43b7-805f-914e78250743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=9226b6ed-6daa-43b7-805f-914e78250743,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9226b6ed-6d') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_vif [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=9226b6ed-6daa-43b7-805f-914e78250743,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9226b6ed-6d') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9226b6ed-6d, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ede59392-f066-433e-b670-4536b97ed604) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:30:15 user nova-compute[74587]: INFO os_vif [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=9226b6ed-6daa-43b7-805f-914e78250743,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9226b6ed-6d')
Oct 18 07:30:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQHxhPso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:30:15 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc9969d-4699-4230-8f5c-96c3e3b10a4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:30:15 user nova-compute[74587]: No targets found.
Oct 18 07:30:15 user nova-compute[74587]: iSNS:
Oct 18 07:30:15 user nova-compute[74587]: No targets found.
Oct 18 07:30:15 user nova-compute[74587]: STATIC:
Oct 18 07:30:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59
Oct 18 07:30:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:30:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:30:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039
Oct 18 07:30:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:30:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:30:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740
Oct 18 07:30:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:30:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:30:15 user nova-compute[74587]: FIRMWARE:
Oct 18 07:30:15 user nova-compute[74587]: No targets found.
Oct 18 07:30:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:30:15 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:30:15 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e622e55e-a7a6-4897-84a3-75eb282ba776]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f29bef-e1ab-44e7-a334-7bba465df216]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:30:15 user nova-compute[74587]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:30:15 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:30:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:30:15 user nova-compute[74587]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:30:15 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:30:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f100860cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740'): ({'sdc'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Removing single pathed devices sdc {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a3d38d-216c-4e0c-84e6-5dc281689035]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9cd874-e19b-410c-a747-402259dd695c]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flushing IO for device /dev/sdc {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8130f744-7bcd-4db6-8816-0bdb65e276a0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a06d63-7335-43dc-978f-89acd09439a8]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOeee6813c-d9738ec2b46fc277', '/dev/disk/by-id/scsi-26439373338656332', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_eee6813c') {{(pid=85802) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d96482-4481-4c6a-8e59-5c144b0f5ab6]: (4, None) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d2b773-11cd-4693-adba-c4bfbf1b5a21]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[663dd2fc-bcb6-4f87-8ada-2a5dab097732]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260]
Oct 18 07:30:15 user nova-compute[74587]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260] successful.
Oct 18 07:30:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5130fe63-46d5-4efb-bda0-779449c97c1a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== disconnect_volume: return (324ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:30:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Deleting instance files /opt/stack/data/nova/instances/3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a_del
Oct 18 07:30:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Deletion of /opt/stack/data/nova/instances/3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a_del complete
Oct 18 07:30:15 user nova-compute[74587]: INFO nova.compute.manager [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 18 07:30:15 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:30:15 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:30:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-05d942b6-6d07-4fdf-bf2d-3160acdba929 req-97b9a178-c741-43d6-89ca-3f0f7423aa9d service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received event network-vif-plugged-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:30:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-05d942b6-6d07-4fdf-bf2d-3160acdba929 req-97b9a178-c741-43d6-89ca-3f0f7423aa9d service nova] Acquiring lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-05d942b6-6d07-4fdf-bf2d-3160acdba929 req-97b9a178-c741-43d6-89ca-3f0f7423aa9d service nova] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-05d942b6-6d07-4fdf-bf2d-3160acdba929 req-97b9a178-c741-43d6-89ca-3f0f7423aa9d service nova] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-05d942b6-6d07-4fdf-bf2d-3160acdba929 req-97b9a178-c741-43d6-89ca-3f0f7423aa9d service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] No waiting events found dispatching network-vif-plugged-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:30:16 user nova-compute[74587]: WARNING nova.compute.manager [req-05d942b6-6d07-4fdf-bf2d-3160acdba929 req-97b9a178-c741-43d6-89ca-3f0f7423aa9d service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received unexpected event network-vif-plugged-9226b6ed-6daa-43b7-805f-914e78250743 for instance with vm_state active and task_state deleting.
Oct 18 07:30:17 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:30:17 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Took 1.30 seconds to deallocate network for instance.
Oct 18 07:30:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-4a5bdafe-61d6-4bbe-a7d8-0776c418dd4e req-cceedc5d-11f7-4271-93b4-9a03889d31bf service nova] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Received event network-vif-deleted-9226b6ed-6daa-43b7-805f-914e78250743 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:30:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:17 user nova-compute[74587]: INFO nova.compute.manager [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a] Took 0.81 seconds to detach 1 volumes for instance.
Oct 18 07:30:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:18 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:30:18 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:30:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:18 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Deleted allocations for instance 3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a
Oct 18 07:30:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-934c4c5f-f8f5-44ae-b01f-21cc41596f9d tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "3e21c41a-12d2-4a98-a7c7-21c2e9f4bc0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.817s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:21 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:30:21 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:30:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:30:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:23 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:30:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:30:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:30:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:26 user nova-compute[74587]: DEBUG nova.compute.manager [req-6a96954d-815e-4054-9b07-cac1b0d4e077 req-6c5ddccb-b4f9-4a5a-8a3d-fe2f3371e42b service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received event network-changed-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:30:26 user nova-compute[74587]: DEBUG nova.compute.manager [req-6a96954d-815e-4054-9b07-cac1b0d4e077 req-6c5ddccb-b4f9-4a5a-8a3d-fe2f3371e42b service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Refreshing instance network info cache due to event network-changed-9b4d296c-113e-48e2-a7f7-b18127f93fc0. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:30:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6a96954d-815e-4054-9b07-cac1b0d4e077 req-6c5ddccb-b4f9-4a5a-8a3d-fe2f3371e42b service nova] Acquiring lock "refresh_cache-16088b21-6f4c-4bb5-82e4-51946f015ffd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:30:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6a96954d-815e-4054-9b07-cac1b0d4e077 req-6c5ddccb-b4f9-4a5a-8a3d-fe2f3371e42b service nova] Acquired lock "refresh_cache-16088b21-6f4c-4bb5-82e4-51946f015ffd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:30:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-6a96954d-815e-4054-9b07-cac1b0d4e077 req-6c5ddccb-b4f9-4a5a-8a3d-fe2f3371e42b service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Refreshing network info cache for port 9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:30:27 user nova-compute[74587]: DEBUG nova.network.neutron [req-6a96954d-815e-4054-9b07-cac1b0d4e077 req-6c5ddccb-b4f9-4a5a-8a3d-fe2f3371e42b service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Updated VIF entry in instance network info cache for port 9b4d296c-113e-48e2-a7f7-b18127f93fc0. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:30:27 user nova-compute[74587]: DEBUG nova.network.neutron [req-6a96954d-815e-4054-9b07-cac1b0d4e077 req-6c5ddccb-b4f9-4a5a-8a3d-fe2f3371e42b service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Updating instance_info_cache with network_info: [{"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:30:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6a96954d-815e-4054-9b07-cac1b0d4e077 req-6c5ddccb-b4f9-4a5a-8a3d-fe2f3371e42b service nova] Releasing lock "refresh_cache-16088b21-6f4c-4bb5-82e4-51946f015ffd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:30:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:30:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-f92ec6ad-a310-438d-9997-9131417ebec0 req-ef88c482-38a4-40d8-af39-77f83783967b service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received event network-changed-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:30:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-f92ec6ad-a310-438d-9997-9131417ebec0 req-ef88c482-38a4-40d8-af39-77f83783967b service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Refreshing instance network info cache due to event network-changed-c1577f59-272d-4419-b256-d124fcc47d4f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:30:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f92ec6ad-a310-438d-9997-9131417ebec0 req-ef88c482-38a4-40d8-af39-77f83783967b service nova] Acquiring lock "refresh_cache-31fa8ba1-a21e-43b9-9916-2e9245087107" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:30:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f92ec6ad-a310-438d-9997-9131417ebec0 req-ef88c482-38a4-40d8-af39-77f83783967b service nova] Acquired lock "refresh_cache-31fa8ba1-a21e-43b9-9916-2e9245087107" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:30:27 user nova-compute[74587]: DEBUG nova.network.neutron [req-f92ec6ad-a310-438d-9997-9131417ebec0 req-ef88c482-38a4-40d8-af39-77f83783967b service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Refreshing network info cache for port c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-f92ec6ad-a310-438d-9997-9131417ebec0 req-ef88c482-38a4-40d8-af39-77f83783967b service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Updated VIF entry in instance network info cache for port c1577f59-272d-4419-b256-d124fcc47d4f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-f92ec6ad-a310-438d-9997-9131417ebec0 req-ef88c482-38a4-40d8-af39-77f83783967b service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Updating instance_info_cache with network_info: [{"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f92ec6ad-a310-438d-9997-9131417ebec0 req-ef88c482-38a4-40d8-af39-77f83783967b service nova] Releasing lock "refresh_cache-31fa8ba1-a21e-43b9-9916-2e9245087107" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 773850ee-146d-4e76-9096-8dc18e03221f {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updating instance_info_cache with network_info: [{"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-773850ee-146d-4e76-9096-8dc18e03221f" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:30:28 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:30:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lazy-loading 'flavor' on Instance uuid 16088b21-6f4c-4bb5-82e4-51946f015ffd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:33 user nova-compute[74587]: INFO nova.compute.manager [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Attaching volume f58c6e3c-9528-4ac4-8573-8322bb9257e7 to /dev/vdb
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG os_brick.utils [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e319e393-96fa-46e8-984c-5979eb30e28e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "31fa8ba1-a21e-43b9-9916-2e9245087107" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:33 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:30:33 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:30:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7866MB free_disk=25.219257354736328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG nova.objects.instance [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'flavor' on Instance uuid 31fa8ba1-a21e-43b9-9916-2e9245087107 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b7fe72-17f8-4a7c-a9a2-6a4b3599b699]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7f68c9-ae39-4a41-8da2-743e7ae82528]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4999b17f-330c-475a-b25d-725b7b9e321c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:30:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:30:34 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a5875a-a482-4e01-b6b2-3d7e69deb8eb]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG os_brick.utils [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] <== get_connector_properties: return (522ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Updating existing volume attachment record: 4f01d7dc-01f0-48bd-ac51-b6881f6ba19c {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.159s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 665a2f6d-4704-400e-aeca-ae8cb29333da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance bb153556-57ca-4401-894a-e3588a05e460 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 16088b21-6f4c-4bb5-82e4-51946f015ffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 31fa8ba1-a21e-43b9-9916-2e9245087107 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ba90228d-2d1f-436d-b169-9ef728328f35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 7df5792a-005a-49b9-856f-7758869917fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "31fa8ba1-a21e-43b9-9916-2e9245087107" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:34 user nova-compute[74587]: INFO nova.compute.manager [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Attaching volume 5a1db1e6-028c-4c38-88bd-4bdd475b8584 to /dev/vdb
Oct 18 07:30:34 user nova-compute[74587]: DEBUG os_brick.utils [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5c26e5-f82f-4976-8391-7ec3d914adc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[daff9d54-d151-46fd-9762-6fa2f37f250b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28db0c1-a47b-45ed-a535-24d97ce20210]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee497da-0cdc-4732-a053-9d0439170455]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:30:34 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:30:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dc714c-3522-4c55-ac64-de2d2d06be08]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG os_brick.utils [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:30:34 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Updating existing volume attachment record: 61082310-e6f9-44b4-a26c-a57e97e3e58f {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:30:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Acquiring lock "ba90228d-2d1f-436d-b169-9ef728328f35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "ba90228d-2d1f-436d-b169-9ef728328f35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Acquiring lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:46 user nova-compute[74587]: INFO nova.compute.manager [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Terminating instance
Oct 18 07:30:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:30:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-5e603903-ff05-4502-98d0-def6ba8ed821 req-772ab102-0492-47a0-bb72-fa109c27b81d service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Received event network-vif-unplugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5e603903-ff05-4502-98d0-def6ba8ed821 req-772ab102-0492-47a0-bb72-fa109c27b81d service nova] Acquiring lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5e603903-ff05-4502-98d0-def6ba8ed821 req-772ab102-0492-47a0-bb72-fa109c27b81d service nova] Lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5e603903-ff05-4502-98d0-def6ba8ed821 req-772ab102-0492-47a0-bb72-fa109c27b81d service nova] Lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-5e603903-ff05-4502-98d0-def6ba8ed821 req-772ab102-0492-47a0-bb72-fa109c27b81d service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] No waiting events found dispatching network-vif-unplugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-5e603903-ff05-4502-98d0-def6ba8ed821 req-772ab102-0492-47a0-bb72-fa109c27b81d service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Received event network-vif-unplugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:47 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Instance destroyed successfully.
Oct 18 07:30:47 user nova-compute[74587]: DEBUG nova.objects.instance [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lazy-loading 'resources' on Instance uuid ba90228d-2d1f-436d-b169-9ef728328f35 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1337550328',display_name='tempest-VolumesActionsTest-instance-1337550328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1337550328',id=36,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:28:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='744a2911afd9453380cc4a7fdd544d8c',ramdisk_id='',reservation_id='r-7zlgsv15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-730034340',owner_user_name='tempest-VolumesActionsTest-730034340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:28:51Z,user_data=None,user_id='6f85bb012d6c490998c7dfd8dacf067d',uuid=ba90228d-2d1f-436d-b169-9ef728328f35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "address": "fa:16:3e:60:27:a2", "network": {"id": "19ef37c8-2359-4970-8965-aa7427eff4cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-522930903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "744a2911afd9453380cc4a7fdd544d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d2a57dc-3e", "ovs_interfaceid": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Converting VIF {"id": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "address": "fa:16:3e:60:27:a2", "network": {"id": "19ef37c8-2359-4970-8965-aa7427eff4cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-522930903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "744a2911afd9453380cc4a7fdd544d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d2a57dc-3e", "ovs_interfaceid": "5d2a57dc-3e06-41f3-ba3d-24fdebcab987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:27:a2,bridge_name='br-int',has_traffic_filtering=True,id=5d2a57dc-3e06-41f3-ba3d-24fdebcab987,network=Network(19ef37c8-2359-4970-8965-aa7427eff4cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d2a57dc-3e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG os_vif [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:27:a2,bridge_name='br-int',has_traffic_filtering=True,id=5d2a57dc-3e06-41f3-ba3d-24fdebcab987,network=Network(19ef37c8-2359-4970-8965-aa7427eff4cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d2a57dc-3e') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d2a57dc-3e, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ca13971-f492-4f65-bbe8-0f1cb254bdf0) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:47 user nova-compute[74587]: INFO os_vif [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:27:a2,bridge_name='br-int',has_traffic_filtering=True,id=5d2a57dc-3e06-41f3-ba3d-24fdebcab987,network=Network(19ef37c8-2359-4970-8965-aa7427eff4cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d2a57dc-3e')
Oct 18 07:30:47 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Deleting instance files /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35_del
Oct 18 07:30:47 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Deletion of /opt/stack/data/nova/instances/ba90228d-2d1f-436d-b169-9ef728328f35_del complete
Oct 18 07:30:47 user nova-compute[74587]: INFO nova.compute.manager [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 18 07:30:47 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:30:47 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:30:48 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:30:48 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Took 0.77 seconds to deallocate network for instance.
Oct 18 07:30:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:48 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:30:48 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:30:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:48 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Deleted allocations for instance ba90228d-2d1f-436d-b169-9ef728328f35
Oct 18 07:30:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d3d90a6-7f2d-4553-880f-487f156aa240 tempest-VolumesActionsTest-730034340 tempest-VolumesActionsTest-730034340-project-member] Lock "ba90228d-2d1f-436d-b169-9ef728328f35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.024s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-bfa22fb9-18b8-4814-b789-af2e78d92068 req-54c8b724-4750-46ad-b563-e0161a19b7ea service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Received event network-vif-plugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:30:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bfa22fb9-18b8-4814-b789-af2e78d92068 req-54c8b724-4750-46ad-b563-e0161a19b7ea service nova] Acquiring lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bfa22fb9-18b8-4814-b789-af2e78d92068 req-54c8b724-4750-46ad-b563-e0161a19b7ea service nova] Lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bfa22fb9-18b8-4814-b789-af2e78d92068 req-54c8b724-4750-46ad-b563-e0161a19b7ea service nova] Lock "ba90228d-2d1f-436d-b169-9ef728328f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-bfa22fb9-18b8-4814-b789-af2e78d92068 req-54c8b724-4750-46ad-b563-e0161a19b7ea service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] No waiting events found dispatching network-vif-plugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:30:49 user nova-compute[74587]: WARNING nova.compute.manager [req-bfa22fb9-18b8-4814-b789-af2e78d92068 req-54c8b724-4750-46ad-b563-e0161a19b7ea service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Received unexpected event network-vif-plugged-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 for instance with vm_state deleted and task_state None.
Oct 18 07:30:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-bfa22fb9-18b8-4814-b789-af2e78d92068 req-54c8b724-4750-46ad-b563-e0161a19b7ea service nova] [instance: ba90228d-2d1f-436d-b169-9ef728328f35] Received event network-vif-deleted-5d2a57dc-3e06-41f3-ba3d-24fdebcab987 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSsGawpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:30:51 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:30:51 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:30:51 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cedca7e-b64a-4cad-8251-198339020454]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:30:51 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9939813-599f-4f35-9cda-6ab4a641cb98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7] added
Oct 18 07:30:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a721fb-e3f7-4625-8f0d-597d057cffc3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.045s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[68168316-3307-4a65-b283-d593e4f37e63]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSsGawpr {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSsGawpr" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a59f2f2-46bd-4cb1-aba2-29d8fa4c06ea]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dSsGawpr'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaea62fa-e236-4cea-9e1c-20bf050b6919]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a973cfe2-4cf6-444c-8d28-25306fa9b32c]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:30:51 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:30:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:30:51 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:30:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94fb9ad-311b-4398-8b4b-509302027692]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7, portal: 172.16.0.220,3260]
Oct 18 07:30:51 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7, portal: 172.16.0.220,3260] successful.
Oct 18 07:30:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c246ddbf-4bd5-498f-bb51-39e1a6e681bd]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e7809b-fc29-495b-9206-7263b4d9e660]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:30:51 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:30:51 user nova-compute[74587]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)
Oct 18 07:30:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:30:51 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:30:51 user nova-compute[74587]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)
Oct 18 07:30:51 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd1784-f81e-42e7-a97e-f366909cf542]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSsGawpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZXYHhrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:30:51 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:30:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23665346466303364', 'path': '/dev/sdc'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665346466303364', 'path': '/dev/sdc'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.962s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:30:52 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:30:52 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lazy-loading 'flavor' on Instance uuid 16088b21-6f4c-4bb5-82e4-51946f015ffd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70b383e-3b98-4df9-8812-4374576e3fb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:30:52 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:30:52 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:30:52 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:30:52 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:30:52 user nova-compute[74587]:   <serial>f58c6e3c-9528-4ac4-8573-8322bb9257e7</serial>
Oct 18 07:30:52 user nova-compute[74587]: </disk>
Oct 18 07:30:52 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8106bb7-75bd-4662-afa1-be8fd5ca98bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584] added
Oct 18 07:30:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dda06d-8315-4c15-bf8f-21bf311df194]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1217abfc-1f1f-4a1f-aa5d-3d4b46fb235b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZXYHhrE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZXYHhrE" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[393b829a-6bde-4ec8-9b51-6da57572ab6d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OZXYHhrE'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2187fa35-a7fd-4280-8a9f-32b444bece69]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[89760655-e589-403c-ac3e-65502aa3635e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca60a985-606a-4aef-95e2-a2b7723c4849]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584, portal: 172.16.0.220,3260]
Oct 18 07:30:52 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584, portal: 172.16.0.220,3260] successful.
Oct 18 07:30:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fa759f-a94b-4bce-8cb2-d4532dc8ea48]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a165e25d-0886-421b-87ca-3b133636b716]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 (non-flash)
Oct 18 07:30:52 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bf3540-8f32-4b34-a712-e2f609083455]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:30:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] No VIF found with MAC fa:16:3e:80:91:17, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:30:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f489e899-ec94-4f51-930c-027257efd46e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.621s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:53 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:30:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZXYHhrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:30:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:30:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] <== connect_volume: return (2272ms) {'type': 'block', 'scsi_wwn': '23235303064383138', 'path': '/dev/sde'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:30:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235303064383138', 'path': '/dev/sde'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:30:53 user nova-compute[74587]: DEBUG nova.objects.instance [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'flavor' on Instance uuid 31fa8ba1-a21e-43b9-9916-2e9245087107 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:30:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:30:53 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:30:53 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:30:53 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:30:53 user nova-compute[74587]:   <serial>5a1db1e6-028c-4c38-88bd-4bdd475b8584</serial>
Oct 18 07:30:53 user nova-compute[74587]: </disk>
Oct 18 07:30:53 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:30:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:30:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:30:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] No VIF found with MAC fa:16:3e:42:5e:2f, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:30:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-949ab431-fc67-49d1-a3b7-49514fcc9d87 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.123s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:30:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "31fa8ba1-a21e-43b9-9916-2e9245087107" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:55 user nova-compute[74587]: INFO nova.compute.manager [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Detaching volume 5a1db1e6-028c-4c38-88bd-4bdd475b8584
Oct 18 07:30:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:30:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:30:55 user nova-compute[74587]: INFO nova.compute.manager [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Detaching volume f58c6e3c-9528-4ac4-8573-8322bb9257e7
Oct 18 07:30:55 user nova-compute[74587]: INFO nova.virt.block_device [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Attempting to driver detach volume 5a1db1e6-028c-4c38-88bd-4bdd475b8584 from mountpoint /dev/vdb
Oct 18 07:30:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Attempting to detach device vdb from instance 31fa8ba1-a21e-43b9-9916-2e9245087107 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:30:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:30:55 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:30:55 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:30:55 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:30:55 user nova-compute[74587]:   <serial>5a1db1e6-028c-4c38-88bd-4bdd475b8584</serial>
Oct 18 07:30:55 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:30:55 user nova-compute[74587]: </disk>
Oct 18 07:30:55 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:30:55 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully detached device vdb from instance 31fa8ba1-a21e-43b9-9916-2e9245087107 from the persistent domain config.
Oct 18 07:30:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31fa8ba1-a21e-43b9-9916-2e9245087107 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:30:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:30:55 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:30:55 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:30:55 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:30:55 user nova-compute[74587]:   <serial>5a1db1e6-028c-4c38-88bd-4bdd475b8584</serial>
Oct 18 07:30:55 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:30:55 user nova-compute[74587]: </disk>
Oct 18 07:30:55 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:30:55 user nova-compute[74587]: INFO nova.virt.block_device [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Attempting to driver detach volume f58c6e3c-9528-4ac4-8573-8322bb9257e7 from mountpoint /dev/vdb
Oct 18 07:30:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Attempting to detach device vdb from instance 16088b21-6f4c-4bb5-82e4-51946f015ffd from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:30:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:30:55 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:30:55 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:30:55 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:30:55 user nova-compute[74587]:   <serial>f58c6e3c-9528-4ac4-8573-8322bb9257e7</serial>
Oct 18 07:30:55 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:30:55 user nova-compute[74587]: </disk>
Oct 18 07:30:55 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:30:55 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Successfully detached device vdb from instance 16088b21-6f4c-4bb5-82e4-51946f015ffd from the persistent domain config.
Oct 18 07:30:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16088b21-6f4c-4bb5-82e4-51946f015ffd from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:30:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:30:55 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:30:55 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:30:55 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:30:55 user nova-compute[74587]:   <serial>f58c6e3c-9528-4ac4-8573-8322bb9257e7</serial>
Oct 18 07:30:55 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:30:55 user nova-compute[74587]: </disk>
Oct 18 07:30:55 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:30:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31fa8ba1-a21e-43b9-9916-2e9245087107 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:30:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16088b21-6f4c-4bb5-82e4-51946f015ffd {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:30:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:31:06 user nova-compute[74587]: INFO nova.compute.claims [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Claim successful on node user
Oct 18 07:31:06 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:31:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:31:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG nova.policy [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd13de789e98e4ba9ad22d665ff8e4ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cfa00773ba4c5498c56b84ccb307a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:31:06 user nova-compute[74587]: INFO nova.virt.block_device [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Booting with volume fb77fe70-658d-4680-a2da-79b135918740 at /dev/vda
Oct 18 07:31:06 user nova-compute[74587]: DEBUG os_brick.utils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb63340-6a07-44ac-9355-d13346632375]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[488259ef-ba28-418d-b670-8d9ecece7943]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1e378d-69ca-4450-a3cc-2e3186b0478a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3452c0-cdce-4dbb-bb57-0bf6f3ca5227]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:31:07 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:31:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcb4573-d2dc-4b86-8e69-9d48637ca91d]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG os_brick.utils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updating existing volume attachment record: 424a3ed0-6bcb-4337-bc9e-0bcb138cf371 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:31:07 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Successfully created port: 96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Successfully updated port: 96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquired lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-85aa6f23-66bb-4354-8fe4-56907d353158 req-59d68c89-a578-40fc-a8b6-cae18f9dd8bc service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received event network-changed-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-85aa6f23-66bb-4354-8fe4-56907d353158 req-59d68c89-a578-40fc-a8b6-cae18f9dd8bc service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Refreshing instance network info cache due to event network-changed-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-85aa6f23-66bb-4354-8fe4-56907d353158 req-59d68c89-a578-40fc-a8b6-cae18f9dd8bc service nova] Acquiring lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updating instance_info_cache with network_info: [{"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Releasing lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Instance network_info: |[{"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-85aa6f23-66bb-4354-8fe4-56907d353158 req-59d68c89-a578-40fc-a8b6-cae18f9dd8bc service nova] Acquired lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG nova.network.neutron [req-85aa6f23-66bb-4354-8fe4-56907d353158 req-59d68c89-a578-40fc-a8b6-cae18f9dd8bc service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Refreshing network info cache for port 96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG nova.network.neutron [req-85aa6f23-66bb-4354-8fe4-56907d353158 req-59d68c89-a578-40fc-a8b6-cae18f9dd8bc service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updated VIF entry in instance network info cache for port 96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG nova.network.neutron [req-85aa6f23-66bb-4354-8fe4-56907d353158 req-59d68c89-a578-40fc-a8b6-cae18f9dd8bc service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updating instance_info_cache with network_info: [{"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:31:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-85aa6f23-66bb-4354-8fe4-56907d353158 req-59d68c89-a578-40fc-a8b6-cae18f9dd8bc service nova] Releasing lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:31:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:31:15 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 31fa8ba1-a21e-43b9-9916-2e9245087107 is timed out.
Oct 18 07:31:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully detached device vdb from instance 31fa8ba1-a21e-43b9-9916-2e9245087107 from the live domain config.
Oct 18 07:31:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZXYHhrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:31:15 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bbbec3-975c-4dfc-a8e5-ef0763b5156a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:31:15 user nova-compute[74587]: No targets found.
Oct 18 07:31:15 user nova-compute[74587]: iSNS:
Oct 18 07:31:15 user nova-compute[74587]: No targets found.
Oct 18 07:31:15 user nova-compute[74587]: STATIC:
Oct 18 07:31:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584
Oct 18 07:31:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:31:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:31:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7
Oct 18 07:31:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:31:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:31:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59
Oct 18 07:31:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:31:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:31:15 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039
Oct 18 07:31:15 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:31:15 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:31:15 user nova-compute[74587]: FIRMWARE:
Oct 18 07:31:15 user nova-compute[74587]: No targets found.
Oct 18 07:31:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:31:15 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:31:15 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d36b41-7249-4a74-852c-5c3677289578]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b225fa2e-f6db-417a-a05c-519cfebb08f8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:31:15 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:31:15 user nova-compute[74587]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)
Oct 18 07:31:15 user nova-compute[74587]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 (non-flash)
Oct 18 07:31:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:31:15 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:31:15 user nova-compute[74587]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)
Oct 18 07:31:15 user nova-compute[74587]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 (non-flash)
Oct 18 07:31:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10085a9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584'): ({'sde'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Removing single pathed devices sde {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a61366-6249-4adc-98ba-471edba39216]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aa7908-55a2-4524-9e3c-ac9ec5283a6d]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Flushing IO for device /dev/sde {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f125db-9587-4685-ab8e-7be604e4e1dc]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c18005-af95-4ac6-a082-daca2e41186b]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3312579b-2de8-435b-abaf-1d1da888e241]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:15 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 16088b21-6f4c-4bb5-82e4-51946f015ffd is timed out.
Oct 18 07:31:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Successfully detached device vdb from instance 16088b21-6f4c-4bb5-82e4-51946f015ffd from the live domain config.
Oct 18 07:31:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSsGawpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:31:15 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a9c48c-0761-4461-a3e9-544a926e934b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584, portal: 172.16.0.220,3260]
Oct 18 07:31:15 user nova-compute[74587]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584, portal: 172.16.0.220,3260] successful.
Oct 18 07:31:15 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a1db1e6-028c-4c38-88bd-4bdd475b8584 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[353ccf99-fa65-438d-8bbd-7d093d13a891]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] <== disconnect_volume: return (325ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.043s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:31:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[468dabcc-d255-4328-8d58-d38c3d0e0c28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:31:16 user nova-compute[74587]: No targets found.
Oct 18 07:31:16 user nova-compute[74587]: iSNS:
Oct 18 07:31:16 user nova-compute[74587]: No targets found.
Oct 18 07:31:16 user nova-compute[74587]: STATIC:
Oct 18 07:31:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7
Oct 18 07:31:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:31:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:31:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59
Oct 18 07:31:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:31:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:31:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039
Oct 18 07:31:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:31:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:31:16 user nova-compute[74587]: FIRMWARE:
Oct 18 07:31:16 user nova-compute[74587]: No targets found.
Oct 18 07:31:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:31:16 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:31:16 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64fadca-bd96-4658-9edc-5e471faedd4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a918d-c8ce-442a-bd44-f49a41e49951]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:31:16 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:31:16 user nova-compute[74587]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)
Oct 18 07:31:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:31:16 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:31:16 user nova-compute[74587]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 (non-flash)
Oct 18 07:31:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4324310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7'): ({'sdc'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Removing single pathed devices sdc {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8908dda0-975a-4b1e-8485-817883c7a6f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4a8f4c-12c9-4492-882b-41c6ce1a61da]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Flushing IO for device /dev/sdc {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbe8188-5767-4c46-9388-35935307b681]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f7d6d3-97f1-4d75-b108-5ecf54c3a8a6]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe0211a-9202-4e80-a030-db390ab30e4b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[01929124-0f94-480f-9a06-8ad0a387d9c0]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7, portal: 172.16.0.220,3260]
Oct 18 07:31:16 user nova-compute[74587]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7, portal: 172.16.0.220,3260] successful.
Oct 18 07:31:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58c6e3c-9528-4ac4-8573-8322bb9257e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc6a9d-9a6e-4d73-825b-598a4c9a3eb4]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] <== disconnect_volume: return (369ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG nova.objects.instance [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'flavor' on Instance uuid 31fa8ba1-a21e-43b9-9916-2e9245087107 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:31:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6c9532a9-f3f9-49e9-92d1-fd1568a06137 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.889s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lazy-loading 'flavor' on Instance uuid 16088b21-6f4c-4bb5-82e4-51946f015ffd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:31:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:31:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-32a9f191-8606-4e14-b40d-901068a10e50 tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.203s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-f7116606-b575-4531-90fb-5db3e5036ce0 req-afc1a71e-0f00-41c1-9713-a5e9e21fac17 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-changed-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:31:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-f7116606-b575-4531-90fb-5db3e5036ce0 req-afc1a71e-0f00-41c1-9713-a5e9e21fac17 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Refreshing instance network info cache due to event network-changed-2b4a587e-fda7-4b59-9074-241c0cbfe1d9. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:31:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f7116606-b575-4531-90fb-5db3e5036ce0 req-afc1a71e-0f00-41c1-9713-a5e9e21fac17 service nova] Acquiring lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:31:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f7116606-b575-4531-90fb-5db3e5036ce0 req-afc1a71e-0f00-41c1-9713-a5e9e21fac17 service nova] Acquired lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:31:21 user nova-compute[74587]: DEBUG nova.network.neutron [req-f7116606-b575-4531-90fb-5db3e5036ce0 req-afc1a71e-0f00-41c1-9713-a5e9e21fac17 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Refreshing network info cache for port 2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG nova.network.neutron [req-f7116606-b575-4531-90fb-5db3e5036ce0 req-afc1a71e-0f00-41c1-9713-a5e9e21fac17 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updated VIF entry in instance network info cache for port 2b4a587e-fda7-4b59-9074-241c0cbfe1d9. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG nova.network.neutron [req-f7116606-b575-4531-90fb-5db3e5036ce0 req-afc1a71e-0f00-41c1-9713-a5e9e21fac17 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating instance_info_cache with network_info: [{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f7116606-b575-4531-90fb-5db3e5036ce0 req-afc1a71e-0f00-41c1-9713-a5e9e21fac17 service nova] Releasing lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "7df5792a-005a-49b9-856f-7758869917fd" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:22 user nova-compute[74587]: INFO nova.compute.manager [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Shelve offloading
Oct 18 07:31:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG nova.compute.manager [req-c2ef0638-be88-4494-aa50-e3d1f1f90041 req-3d4aa4c1-1ec9-4b34-bd20-896b2930b96a service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-vif-unplugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c2ef0638-be88-4494-aa50-e3d1f1f90041 req-3d4aa4c1-1ec9-4b34-bd20-896b2930b96a service nova] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c2ef0638-be88-4494-aa50-e3d1f1f90041 req-3d4aa4c1-1ec9-4b34-bd20-896b2930b96a service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c2ef0638-be88-4494-aa50-e3d1f1f90041 req-3d4aa4c1-1ec9-4b34-bd20-896b2930b96a service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:22 user nova-compute[74587]: DEBUG nova.compute.manager [req-c2ef0638-be88-4494-aa50-e3d1f1f90041 req-3d4aa4c1-1ec9-4b34-bd20-896b2930b96a service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] No waiting events found dispatching network-vif-unplugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:31:22 user nova-compute[74587]: WARNING nova.compute.manager [req-c2ef0638-be88-4494-aa50-e3d1f1f90041 req-3d4aa4c1-1ec9-4b34-bd20-896b2930b96a service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received unexpected event network-vif-unplugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 for instance with vm_state active and task_state shelving.
Oct 18 07:31:23 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance destroyed successfully.
Oct 18 07:31:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:31:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:31:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquired lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:31:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:31:23 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:31:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating instance_info_cache with network_info: [{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:31:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Releasing lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:31:24 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance destroyed successfully.
Oct 18 07:31:24 user nova-compute[74587]: DEBUG nova.objects.instance [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lazy-loading 'resources' on Instance uuid 7df5792a-005a-49b9-856f-7758869917fd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-283849704',display_name='tempest-TestShelveInstance-server-283849704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-283849704',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkABgU+Vcpq23Lp+OOTXqH5YIc95x7QJ6Mj8W3S09rlS/ucKS/KicjYv0xrTlTUuMuVyT5n13nN5l7SLjfOW4c+gXg636Eb6UmCQPbB++Ff6O/AJNy0ajwcVkUyhrnkGg==',key_name='tempest-TestShelveInstance-262530121',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:29:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='341d61f7861f48899f85601e632ed912',ramdisk_id='',reservation_id='r-0u9l9p27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-906083640',owner_user_name='tempest-TestShelveInstance-906083640-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:29:53Z,user_data=None,user_id='f7c61f0efc8d462bb809d0f512914342',uuid=7df5792a-005a-49b9-856f-7758869917fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converting VIF {"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_vif [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b4a587e-fd, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=994e43a2-5a1f-4047-868f-b694b65f0848) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:24 user nova-compute[74587]: INFO os_vif [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd')
Oct 18 07:31:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcYKVTFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:31:24 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f12eee5-0f2a-4012-aa59-a17894c2729a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:31:24 user nova-compute[74587]: No targets found.
Oct 18 07:31:24 user nova-compute[74587]: iSNS:
Oct 18 07:31:24 user nova-compute[74587]: No targets found.
Oct 18 07:31:24 user nova-compute[74587]: STATIC:
Oct 18 07:31:24 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59
Oct 18 07:31:24 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:31:24 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:31:24 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039
Oct 18 07:31:24 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:31:24 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:31:24 user nova-compute[74587]: FIRMWARE:
Oct 18 07:31:24 user nova-compute[74587]: No targets found.
Oct 18 07:31:24 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:31:24 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:31:24 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f84cc53-d48d-4015-a38e-53e3468c9dee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac6eade-2009-407e-8f15-04230e0db0e2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:31:24 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:31:24 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:31:24 user nova-compute[74587]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:31:24 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46af010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59'): ({'sdd'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Removing single pathed devices sdd {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0fb5ac-2ee9-4f92-ac94-a5bdc9e795a9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b04d3e9-267d-4dee-92c3-eef444d1b626]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Flushing IO for device /dev/sdd {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06c9fdb-83d4-402d-9727-149a67967732]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG nova.compute.manager [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG nova.compute.manager [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] No waiting events found dispatching network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:31:24 user nova-compute[74587]: WARNING nova.compute.manager [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received unexpected event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 for instance with vm_state active and task_state shelving.
Oct 18 07:31:24 user nova-compute[74587]: DEBUG nova.compute.manager [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-changed-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG nova.compute.manager [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Refreshing instance network info cache due to event network-changed-2b4a587e-fda7-4b59-9074-241c0cbfe1d9. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] Acquiring lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] Acquired lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG nova.network.neutron [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Refreshing network info cache for port 2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.126s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4491abca-1672-41e5-a2cc-ac0a7665966f]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.163s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7927da6d-3dcb-4ae8-8d83-921894d8b336]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[78210cf9-b20d-4353-8489-006cb421bef1]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260]
Oct 18 07:31:25 user nova-compute[74587]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260] successful.
Oct 18 07:31:25 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbce337-6887-4c41-a093-33cc39fce3bc]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.566s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] <== disconnect_volume: return (567ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:31:25 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Deleting instance files /opt/stack/data/nova/instances/7df5792a-005a-49b9-856f-7758869917fd_del
Oct 18 07:31:25 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Deletion of /opt/stack/data/nova/instances/7df5792a-005a-49b9-856f-7758869917fd_del complete
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:31:25 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Creating image(s)
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Ensure instance console log exists: /opt/stack/data/nova/instances/79f2ca30-3797-41a4-bbb2-3431bedbf8f9/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Start _get_guest_xml network_info=[{"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '424a3ed0-6bcb-4337-bc9e-0bcb138cf371', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQHxhPso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '79f2ca30-3797-41a4-bbb2-3431bedbf8f9', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb77fe70-658d-4680-a2da-79b135918740', 'serial': 'fb77fe70-658d-4680-a2da-79b135918740'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.network.neutron [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updated VIF entry in instance network info cache for port 2b4a587e-fda7-4b59-9074-241c0cbfe1d9. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.network.neutron [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating instance_info_cache with network_info: [{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": null, "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:31:25 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:31:25 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQHxhPso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:31:25 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:31:25 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:31:25 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9b49dbca-9012-4796-b031-b653ddc13014 req-9dd7906f-a98a-47c5-bb46-e91aac731341 service nova] Releasing lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[594bb1a4-9283-4e08-a858-3a7910a50d41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:31:25 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e5a724-0cae-4ee7-a2d4-a97717325e49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740] added
Oct 18 07:31:25 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d678a559-f3f4-494a-be45-735fe5e79797]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[be44acac-e211-4b7e-ab19-3535aa37bdae]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQHxhPso {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQHxhPso" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[92517dc5-235b-4820-8304-f7bac68744a0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jQHxhPso'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c87331-d686-4a74-9358-27ca0e91c940]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f127977-7bb8-488b-b591-d56c91de75fd]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:31:25 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:31:25 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fc0a9e-7715-4393-9f27-05c0c6fb8892]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260]
Oct 18 07:31:25 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260] successful.
Oct 18 07:31:25 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28be7d6-26e7-4c48-a2ff-d2e46e82c2a6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d11a043-5a51-4329-97f9-85a7455b09b6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:31:25 user nova-compute[74587]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:31:25 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:31:25 user nova-compute[74587]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:31:25 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[489b8946-a190-4270-bf30-3d19d853b2ec]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:31:25 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:31:26 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Deleted allocations for instance 7df5792a-005a-49b9-856f-7758869917fd
Oct 18 07:31:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.objects.instance [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lazy-loading 'numa_topology' on Instance uuid 7df5792a-005a-49b9-856f-7758869917fd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.objects.base [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Object Instance<7df5792a-005a-49b9-856f-7758869917fd> lazy-loaded attributes: resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7db9af19-878c-4a5f-850b-e18f31d344d1 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "7df5792a-005a-49b9-856f-7758869917fd" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.049s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQHxhPso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26439373338656332', 'path': '/dev/sdc'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439373338656332', 'path': '/dev/sdc'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1080562966',display_name='tempest-TestVolumeBootPattern-server-1080562966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1080562966',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrD4QGeTTaMlXZ8vfsMMfK6pzduYaYdY6TtuahCvtTSdq2mzozIo9GLQClLeKc4Krkj+ygZI/TyGPqsgnJukfJMz2PgqlnAY3XlyONEXn8OLnPP3EVD58CNxJh6K+Kl2g==',key_name='tempest-TestVolumeBootPattern-1340892382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-z51x9ffu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:31:07Z,user_data=None,user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=79f2ca30-3797-41a4-bbb2-3431bedbf8f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f6c3a1-09') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lazy-loading 'pci_devices' on Instance uuid 79f2ca30-3797-41a4-bbb2-3431bedbf8f9 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:31:26 user nova-compute[74587]:   <uuid>79f2ca30-3797-41a4-bbb2-3431bedbf8f9</uuid>
Oct 18 07:31:26 user nova-compute[74587]:   <name>instance-00000026</name>
Oct 18 07:31:26 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:31:26 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:31:26 user nova-compute[74587]:   <metadata>
Oct 18 07:31:26 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:31:26 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:31:26 user nova-compute[74587]:       <nova:name>tempest-TestVolumeBootPattern-server-1080562966</nova:name>
Oct 18 07:31:26 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:31:25</nova:creationTime>
Oct 18 07:31:26 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:31:26 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:31:26 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:31:26 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:31:26 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:31:26 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:31:26 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:31:26 user nova-compute[74587]:       <nova:owner>
Oct 18 07:31:26 user nova-compute[74587]:         <nova:user uuid="d13de789e98e4ba9ad22d665ff8e4ddd">tempest-TestVolumeBootPattern-1301266373-project-member</nova:user>
Oct 18 07:31:26 user nova-compute[74587]:         <nova:project uuid="f1cfa00773ba4c5498c56b84ccb307a9">tempest-TestVolumeBootPattern-1301266373</nova:project>
Oct 18 07:31:26 user nova-compute[74587]:       </nova:owner>
Oct 18 07:31:26 user nova-compute[74587]:       <nova:ports>
Oct 18 07:31:26 user nova-compute[74587]:         <nova:port uuid="96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f">
Oct 18 07:31:26 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 07:31:26 user nova-compute[74587]:         </nova:port>
Oct 18 07:31:26 user nova-compute[74587]:       </nova:ports>
Oct 18 07:31:26 user nova-compute[74587]:     </nova:instance>
Oct 18 07:31:26 user nova-compute[74587]:   </metadata>
Oct 18 07:31:26 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:31:26 user nova-compute[74587]:     <system>
Oct 18 07:31:26 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:31:26 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:31:26 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:31:26 user nova-compute[74587]:       <entry name="serial">79f2ca30-3797-41a4-bbb2-3431bedbf8f9</entry>
Oct 18 07:31:26 user nova-compute[74587]:       <entry name="uuid">79f2ca30-3797-41a4-bbb2-3431bedbf8f9</entry>
Oct 18 07:31:26 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:31:26 user nova-compute[74587]:     </system>
Oct 18 07:31:26 user nova-compute[74587]:   </sysinfo>
Oct 18 07:31:26 user nova-compute[74587]:   <os>
Oct 18 07:31:26 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:31:26 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:31:26 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:31:26 user nova-compute[74587]:   </os>
Oct 18 07:31:26 user nova-compute[74587]:   <features>
Oct 18 07:31:26 user nova-compute[74587]:     <acpi/>
Oct 18 07:31:26 user nova-compute[74587]:     <apic/>
Oct 18 07:31:26 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:31:26 user nova-compute[74587]:   </features>
Oct 18 07:31:26 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:31:26 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:31:26 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:31:26 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:31:26 user nova-compute[74587]:   </clock>
Oct 18 07:31:26 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:31:26 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:31:26 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:31:26 user nova-compute[74587]:   </cpu>
Oct 18 07:31:26 user nova-compute[74587]:   <devices>
Oct 18 07:31:26 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:31:26 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:31:26 user nova-compute[74587]:       <source dev="/dev/sdc"/>
Oct 18 07:31:26 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:31:26 user nova-compute[74587]:       <serial>fb77fe70-658d-4680-a2da-79b135918740</serial>
Oct 18 07:31:26 user nova-compute[74587]:     </disk>
Oct 18 07:31:26 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:31:26 user nova-compute[74587]:       <mac address="fa:16:3e:2a:64:e5"/>
Oct 18 07:31:26 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:31:26 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:31:26 user nova-compute[74587]:       <target dev="tap96f6c3a1-09"/>
Oct 18 07:31:26 user nova-compute[74587]:     </interface>
Oct 18 07:31:26 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:31:26 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/79f2ca30-3797-41a4-bbb2-3431bedbf8f9/console.log" append="off"/>
Oct 18 07:31:26 user nova-compute[74587]:     </serial>
Oct 18 07:31:26 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:31:26 user nova-compute[74587]:     <video>
Oct 18 07:31:26 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:31:26 user nova-compute[74587]:     </video>
Oct 18 07:31:26 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:31:26 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:31:26 user nova-compute[74587]:     </rng>
Oct 18 07:31:26 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:31:26 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:31:26 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:31:26 user nova-compute[74587]:     </memballoon>
Oct 18 07:31:26 user nova-compute[74587]:   </devices>
Oct 18 07:31:26 user nova-compute[74587]: </domain>
Oct 18 07:31:26 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1080562966',display_name='tempest-TestVolumeBootPattern-server-1080562966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1080562966',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrD4QGeTTaMlXZ8vfsMMfK6pzduYaYdY6TtuahCvtTSdq2mzozIo9GLQClLeKc4Krkj+ygZI/TyGPqsgnJukfJMz2PgqlnAY3XlyONEXn8OLnPP3EVD58CNxJh6K+Kl2g==',key_name='tempest-TestVolumeBootPattern-1340892382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-z51x9ffu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:31:07Z,user_data=None,user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=79f2ca30-3797-41a4-bbb2-3431bedbf8f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f6c3a1-09') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG os_vif [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f6c3a1-09') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15928ec6-f175-531c-bbaf-4d27501f6bb6', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96f6c3a1-09, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96f6c3a1-09, col_values=(('qos', UUID('011623ee-3c8e-472a-a8e4-4f34593d3074')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96f6c3a1-09, col_values=(('external_ids', {'iface-id': '96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:64:e5', 'vm-uuid': '79f2ca30-3797-41a4-bbb2-3431bedbf8f9'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:26 user nova-compute[74587]: INFO os_vif [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f6c3a1-09')
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:31:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] No VIF found with MAC fa:16:3e:2a:64:e5, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:31:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:31:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-827b3a15-af81-48fc-a924-628e4ecacb1a req-c6163dae-bcff-435d-9b41-d95ccf9b5680 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received event network-vif-plugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-827b3a15-af81-48fc-a924-628e4ecacb1a req-c6163dae-bcff-435d-9b41-d95ccf9b5680 service nova] Acquiring lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-827b3a15-af81-48fc-a924-628e4ecacb1a req-c6163dae-bcff-435d-9b41-d95ccf9b5680 service nova] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-827b3a15-af81-48fc-a924-628e4ecacb1a req-c6163dae-bcff-435d-9b41-d95ccf9b5680 service nova] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-827b3a15-af81-48fc-a924-628e4ecacb1a req-c6163dae-bcff-435d-9b41-d95ccf9b5680 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] No waiting events found dispatching network-vif-plugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:31:28 user nova-compute[74587]: WARNING nova.compute.manager [req-827b3a15-af81-48fc-a924-628e4ecacb1a req-c6163dae-bcff-435d-9b41-d95ccf9b5680 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received unexpected event network-vif-plugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f for instance with vm_state building and task_state spawning.
Oct 18 07:31:28 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:31:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Instance spawned successfully.
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-c83dc27c-e1cd-440a-bc50-df227beab2e6 req-0f9c86bd-a353-4255-8529-761c031c87dc service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received event network-vif-plugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c83dc27c-e1cd-440a-bc50-df227beab2e6 req-0f9c86bd-a353-4255-8529-761c031c87dc service nova] Acquiring lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c83dc27c-e1cd-440a-bc50-df227beab2e6 req-0f9c86bd-a353-4255-8529-761c031c87dc service nova] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c83dc27c-e1cd-440a-bc50-df227beab2e6 req-0f9c86bd-a353-4255-8529-761c031c87dc service nova] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-c83dc27c-e1cd-440a-bc50-df227beab2e6 req-0f9c86bd-a353-4255-8529-761c031c87dc service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] No waiting events found dispatching network-vif-plugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:31:30 user nova-compute[74587]: WARNING nova.compute.manager [req-c83dc27c-e1cd-440a-bc50-df227beab2e6 req-0f9c86bd-a353-4255-8529-761c031c87dc service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received unexpected event network-vif-plugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f for instance with vm_state building and task_state spawning.
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:31:30 user nova-compute[74587]: INFO nova.compute.manager [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Took 5.18 seconds to spawn the instance on the hypervisor.
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:31:30 user nova-compute[74587]: INFO nova.compute.manager [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Took 24.27 seconds to build instance.
Oct 18 07:31:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e971f8d2-e6a6-4965-8716-180ab004f0f0 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.373s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Updating instance_info_cache with network_info: [{"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-665a2f6d-4704-400e-aeca-ae8cb29333da" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:31:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:31:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:31:34 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:31:34 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=25.235122680664062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 665a2f6d-4704-400e-aeca-ae8cb29333da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance bb153556-57ca-4401-894a-e3588a05e460 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 16088b21-6f4c-4bb5-82e4-51946f015ffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 31fa8ba1-a21e-43b9-9916-2e9245087107 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 79f2ca30-3797-41a4-bbb2-3431bedbf8f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:31:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "31fa8ba1-a21e-43b9-9916-2e9245087107" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:45 user nova-compute[74587]: INFO nova.compute.manager [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Terminating instance
Oct 18 07:31:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-2a282fcb-e44e-4877-9056-a28afc42ebeb req-01be74fa-fcd7-46a2-921d-356cd897623f service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received event network-vif-unplugged-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2a282fcb-e44e-4877-9056-a28afc42ebeb req-01be74fa-fcd7-46a2-921d-356cd897623f service nova] Acquiring lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2a282fcb-e44e-4877-9056-a28afc42ebeb req-01be74fa-fcd7-46a2-921d-356cd897623f service nova] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2a282fcb-e44e-4877-9056-a28afc42ebeb req-01be74fa-fcd7-46a2-921d-356cd897623f service nova] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-2a282fcb-e44e-4877-9056-a28afc42ebeb req-01be74fa-fcd7-46a2-921d-356cd897623f service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] No waiting events found dispatching network-vif-unplugged-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:31:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-2a282fcb-e44e-4877-9056-a28afc42ebeb req-01be74fa-fcd7-46a2-921d-356cd897623f service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received event network-vif-unplugged-c1577f59-272d-4419-b256-d124fcc47d4f for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:31:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Instance destroyed successfully.
Oct 18 07:31:46 user nova-compute[74587]: DEBUG nova.objects.instance [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lazy-loading 'resources' on Instance uuid 31fa8ba1-a21e-43b9-9916-2e9245087107 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1571661449',display_name='tempest-AttachVolumeNegativeTest-server-1571661449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1571661449',id=35,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiEmsNJcdVCniBy236KaMsJ0fnIHhkkej3j3rVDDqlzF47aQh+w/Z/7P9pX7mPwSpB4c/kFD3xiI7Qpv+4rZjPmsr/czfCn71aeRZRPFBas1pkyuy2MahHH2AQgXgTwsQ==',key_name='tempest-keypair-746089352',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:28:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cc0eafb55fd4673a3d8fcb0e63602c7',ramdisk_id='',reservation_id='r-qpwi12qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-859195449',owner_user_name='tempest-AttachVolumeNegativeTest-859195449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aceede4662a4aaa92c79dfd538effea',uuid=31fa8ba1-a21e-43b9-9916-2e9245087107,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converting VIF {"id": "c1577f59-272d-4419-b256-d124fcc47d4f", "address": "fa:16:3e:42:5e:2f", "network": {"id": "12700db8-dcb8-4292-9ef7-02b4d95d56c3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-454837457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cc0eafb55fd4673a3d8fcb0e63602c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1577f59-27", "ovs_interfaceid": "c1577f59-272d-4419-b256-d124fcc47d4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=c1577f59-272d-4419-b256-d124fcc47d4f,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1577f59-27') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG os_vif [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=c1577f59-272d-4419-b256-d124fcc47d4f,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1577f59-27') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1577f59-27, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a959f033-a851-4bb9-9efc-39d31cc79b32) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:46 user nova-compute[74587]: INFO os_vif [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=c1577f59-272d-4419-b256-d124fcc47d4f,network=Network(12700db8-dcb8-4292-9ef7-02b4d95d56c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1577f59-27')
Oct 18 07:31:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Deleting instance files /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107_del
Oct 18 07:31:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Deletion of /opt/stack/data/nova/instances/31fa8ba1-a21e-43b9-9916-2e9245087107_del complete
Oct 18 07:31:46 user nova-compute[74587]: INFO nova.compute.manager [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 18 07:31:46 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:31:46 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:31:47 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Took 0.84 seconds to deallocate network for instance.
Oct 18 07:31:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-e94b4961-fc0d-4a53-af75-19bf6c41ca70 req-5e181eff-1355-45e7-9ad1-b85580ef34ab service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received event network-vif-deleted-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:47 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Deleted allocations for instance 31fa8ba1-a21e-43b9-9916-2e9245087107
Oct 18 07:31:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6706d1e3-a98c-414b-9f0f-c78ea646ae84 tempest-AttachVolumeNegativeTest-859195449 tempest-AttachVolumeNegativeTest-859195449-project-member] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.155s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-53b63905-b2a6-4e43-b6a9-7a9afee05806 req-f473ef82-8ec3-4ee6-b01f-3856352db5bd service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received event network-vif-plugged-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-53b63905-b2a6-4e43-b6a9-7a9afee05806 req-f473ef82-8ec3-4ee6-b01f-3856352db5bd service nova] Acquiring lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-53b63905-b2a6-4e43-b6a9-7a9afee05806 req-f473ef82-8ec3-4ee6-b01f-3856352db5bd service nova] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-53b63905-b2a6-4e43-b6a9-7a9afee05806 req-f473ef82-8ec3-4ee6-b01f-3856352db5bd service nova] Lock "31fa8ba1-a21e-43b9-9916-2e9245087107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:31:47 user nova-compute[74587]: DEBUG nova.compute.manager [req-53b63905-b2a6-4e43-b6a9-7a9afee05806 req-f473ef82-8ec3-4ee6-b01f-3856352db5bd service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] No waiting events found dispatching network-vif-plugged-c1577f59-272d-4419-b256-d124fcc47d4f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:31:47 user nova-compute[74587]: WARNING nova.compute.manager [req-53b63905-b2a6-4e43-b6a9-7a9afee05806 req-f473ef82-8ec3-4ee6-b01f-3856352db5bd service nova] [instance: 31fa8ba1-a21e-43b9-9916-2e9245087107] Received unexpected event network-vif-plugged-c1577f59-272d-4419-b256-d124fcc47d4f for instance with vm_state deleted and task_state None.
Oct 18 07:31:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:55 user nova-compute[74587]: INFO nova.compute.manager [None req-b41fa859-43a8-45a1-b48c-6f9e071ffe58 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Get console output
Oct 18 07:31:55 user nova-compute[74587]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 18 07:31:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:31:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:32:00 user nova-compute[74587]: INFO nova.compute.claims [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Claim successful on node user
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:32:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.policy [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '623d2be80c4c4d71acf62880b712b376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afab563ad8cb49e58767661bbe79ffd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:32:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Creating image(s)
Oct 18 07:32:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "/opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "/opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "/opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.192s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.197s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk 1073741824" returned: 0 in 0.123s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Successfully created port: ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Cannot resize image /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Ensure instance console log exists: /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Successfully updated port: ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "refresh_cache-03838929-5ebc-4590-98e4-0b8dfa6d4570" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquired lock "refresh_cache-03838929-5ebc-4590-98e4-0b8dfa6d4570" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-318b4eac-ee69-4696-bf40-b8293177af26 req-e3f3772a-0c8f-4884-ab41-b3258d4b5cac service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received event network-changed-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-318b4eac-ee69-4696-bf40-b8293177af26 req-e3f3772a-0c8f-4884-ab41-b3258d4b5cac service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Refreshing instance network info cache due to event network-changed-ba393f25-09d5-4778-9e2b-daba0edc41d6. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-318b4eac-ee69-4696-bf40-b8293177af26 req-e3f3772a-0c8f-4884-ab41-b3258d4b5cac service nova] Acquiring lock "refresh_cache-03838929-5ebc-4590-98e4-0b8dfa6d4570" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Updating instance_info_cache with network_info: [{"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Releasing lock "refresh_cache-03838929-5ebc-4590-98e4-0b8dfa6d4570" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Instance network_info: |[{"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-318b4eac-ee69-4696-bf40-b8293177af26 req-e3f3772a-0c8f-4884-ab41-b3258d4b5cac service nova] Acquired lock "refresh_cache-03838929-5ebc-4590-98e4-0b8dfa6d4570" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-318b4eac-ee69-4696-bf40-b8293177af26 req-e3f3772a-0c8f-4884-ab41-b3258d4b5cac service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Refreshing network info cache for port ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Start _get_guest_xml network_info=[{"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:32:02 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:32:02 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1279404326',display_name='tempest-VolumesSnapshotTestJSON-instance-1279404326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1279404326',id=39,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa+Ue/9g1B+Dv7Fq1y1h+/UAJT1IoJRIdRI1glnYDMkD0F/nJzElJUZYOkG8TZTCYjyhbccoS9dO+YpCmXR4BNbCjvvCq1O5uPqJ3yMps6VJIFZBo55epOXSTXaFPwHAQ==',key_name='tempest-keypair-1576810152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afab563ad8cb49e58767661bbe79ffd3',ramdisk_id='',reservation_id='r-176grjhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1818933927',owner_user_name='tempest-VolumesSnapshotTestJSON-1818933927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623d2be80c4c4d71acf62880b712b376',uuid=03838929-5ebc-4590-98e4-0b8dfa6d4570,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converting VIF {"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=ba393f25-09d5-4778-9e2b-daba0edc41d6,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba393f25-09') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lazy-loading 'pci_devices' on Instance uuid 03838929-5ebc-4590-98e4-0b8dfa6d4570 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:32:02 user nova-compute[74587]:   <uuid>03838929-5ebc-4590-98e4-0b8dfa6d4570</uuid>
Oct 18 07:32:02 user nova-compute[74587]:   <name>instance-00000027</name>
Oct 18 07:32:02 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:32:02 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:32:02 user nova-compute[74587]:   <metadata>
Oct 18 07:32:02 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:32:02 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:32:02 user nova-compute[74587]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1279404326</nova:name>
Oct 18 07:32:02 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:32:02</nova:creationTime>
Oct 18 07:32:02 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:32:02 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:32:02 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:32:02 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:32:02 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:32:02 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:32:02 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:32:02 user nova-compute[74587]:       <nova:owner>
Oct 18 07:32:02 user nova-compute[74587]:         <nova:user uuid="623d2be80c4c4d71acf62880b712b376">tempest-VolumesSnapshotTestJSON-1818933927-project-member</nova:user>
Oct 18 07:32:02 user nova-compute[74587]:         <nova:project uuid="afab563ad8cb49e58767661bbe79ffd3">tempest-VolumesSnapshotTestJSON-1818933927</nova:project>
Oct 18 07:32:02 user nova-compute[74587]:       </nova:owner>
Oct 18 07:32:02 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:32:02 user nova-compute[74587]:       <nova:ports>
Oct 18 07:32:02 user nova-compute[74587]:         <nova:port uuid="ba393f25-09d5-4778-9e2b-daba0edc41d6">
Oct 18 07:32:02 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 07:32:02 user nova-compute[74587]:         </nova:port>
Oct 18 07:32:02 user nova-compute[74587]:       </nova:ports>
Oct 18 07:32:02 user nova-compute[74587]:     </nova:instance>
Oct 18 07:32:02 user nova-compute[74587]:   </metadata>
Oct 18 07:32:02 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:32:02 user nova-compute[74587]:     <system>
Oct 18 07:32:02 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:32:02 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:32:02 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:32:02 user nova-compute[74587]:       <entry name="serial">03838929-5ebc-4590-98e4-0b8dfa6d4570</entry>
Oct 18 07:32:02 user nova-compute[74587]:       <entry name="uuid">03838929-5ebc-4590-98e4-0b8dfa6d4570</entry>
Oct 18 07:32:02 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:32:02 user nova-compute[74587]:     </system>
Oct 18 07:32:02 user nova-compute[74587]:   </sysinfo>
Oct 18 07:32:02 user nova-compute[74587]:   <os>
Oct 18 07:32:02 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:32:02 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:32:02 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:32:02 user nova-compute[74587]:   </os>
Oct 18 07:32:02 user nova-compute[74587]:   <features>
Oct 18 07:32:02 user nova-compute[74587]:     <acpi/>
Oct 18 07:32:02 user nova-compute[74587]:     <apic/>
Oct 18 07:32:02 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:32:02 user nova-compute[74587]:   </features>
Oct 18 07:32:02 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:32:02 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:32:02 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:32:02 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:32:02 user nova-compute[74587]:   </clock>
Oct 18 07:32:02 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:32:02 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:32:02 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:32:02 user nova-compute[74587]:   </cpu>
Oct 18 07:32:02 user nova-compute[74587]:   <devices>
Oct 18 07:32:02 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:32:02 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:32:02 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk"/>
Oct 18 07:32:02 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:32:02 user nova-compute[74587]:     </disk>
Oct 18 07:32:02 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:32:02 user nova-compute[74587]:       <mac address="fa:16:3e:e8:9c:0b"/>
Oct 18 07:32:02 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:32:02 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:32:02 user nova-compute[74587]:       <target dev="tapba393f25-09"/>
Oct 18 07:32:02 user nova-compute[74587]:     </interface>
Oct 18 07:32:02 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:32:02 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/console.log" append="off"/>
Oct 18 07:32:02 user nova-compute[74587]:     </serial>
Oct 18 07:32:02 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:32:02 user nova-compute[74587]:     <video>
Oct 18 07:32:02 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:32:02 user nova-compute[74587]:     </video>
Oct 18 07:32:02 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:32:02 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:32:02 user nova-compute[74587]:     </rng>
Oct 18 07:32:02 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:32:02 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:32:02 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:32:02 user nova-compute[74587]:     </memballoon>
Oct 18 07:32:02 user nova-compute[74587]:   </devices>
Oct 18 07:32:02 user nova-compute[74587]: </domain>
Oct 18 07:32:02 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1279404326',display_name='tempest-VolumesSnapshotTestJSON-instance-1279404326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1279404326',id=39,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa+Ue/9g1B+Dv7Fq1y1h+/UAJT1IoJRIdRI1glnYDMkD0F/nJzElJUZYOkG8TZTCYjyhbccoS9dO+YpCmXR4BNbCjvvCq1O5uPqJ3yMps6VJIFZBo55epOXSTXaFPwHAQ==',key_name='tempest-keypair-1576810152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afab563ad8cb49e58767661bbe79ffd3',ramdisk_id='',reservation_id='r-176grjhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1818933927',owner_user_name='tempest-VolumesSnapshotTestJSON-1818933927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623d2be80c4c4d71acf62880b712b376',uuid=03838929-5ebc-4590-98e4-0b8dfa6d4570,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converting VIF {"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=ba393f25-09d5-4778-9e2b-daba0edc41d6,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba393f25-09') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG os_vif [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=ba393f25-09d5-4778-9e2b-daba0edc41d6,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba393f25-09') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31786b15-c3fc-5f32-9e09-8784bcbdc766', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba393f25-09, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba393f25-09, col_values=(('qos', UUID('19abcc0b-3749-4733-82f6-d8910a086f0c')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba393f25-09, col_values=(('external_ids', {'iface-id': 'ba393f25-09d5-4778-9e2b-daba0edc41d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:9c:0b', 'vm-uuid': '03838929-5ebc-4590-98e4-0b8dfa6d4570'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:02 user nova-compute[74587]: INFO os_vif [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=ba393f25-09d5-4778-9e2b-daba0edc41d6,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba393f25-09')
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] No VIF found with MAC fa:16:3e:e8:9c:0b, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-318b4eac-ee69-4696-bf40-b8293177af26 req-e3f3772a-0c8f-4884-ab41-b3258d4b5cac service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Updated VIF entry in instance network info cache for port ba393f25-09d5-4778-9e2b-daba0edc41d6. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-318b4eac-ee69-4696-bf40-b8293177af26 req-e3f3772a-0c8f-4884-ab41-b3258d4b5cac service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Updating instance_info_cache with network_info: [{"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:32:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-318b4eac-ee69-4696-bf40-b8293177af26 req-e3f3772a-0c8f-4884-ab41-b3258d4b5cac service nova] Releasing lock "refresh_cache-03838929-5ebc-4590-98e4-0b8dfa6d4570" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:32:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-89e21fa6-cb2f-411e-b4ba-ae1114d8437a req-09f3b67f-623f-4683-a97c-d5aea2eea5aa service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received event network-vif-plugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89e21fa6-cb2f-411e-b4ba-ae1114d8437a req-09f3b67f-623f-4683-a97c-d5aea2eea5aa service nova] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89e21fa6-cb2f-411e-b4ba-ae1114d8437a req-09f3b67f-623f-4683-a97c-d5aea2eea5aa service nova] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89e21fa6-cb2f-411e-b4ba-ae1114d8437a req-09f3b67f-623f-4683-a97c-d5aea2eea5aa service nova] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-89e21fa6-cb2f-411e-b4ba-ae1114d8437a req-09f3b67f-623f-4683-a97c-d5aea2eea5aa service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] No waiting events found dispatching network-vif-plugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:32:04 user nova-compute[74587]: WARNING nova.compute.manager [req-89e21fa6-cb2f-411e-b4ba-ae1114d8437a req-09f3b67f-623f-4683-a97c-d5aea2eea5aa service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received unexpected event network-vif-plugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 for instance with vm_state building and task_state spawning.
Oct 18 07:32:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:32:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Instance spawned successfully.
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-56d2241e-0214-4558-82b1-2f125646ecce req-17692e59-159b-4d93-b3e9-6b92afc6bfa9 service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received event network-vif-plugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-56d2241e-0214-4558-82b1-2f125646ecce req-17692e59-159b-4d93-b3e9-6b92afc6bfa9 service nova] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-56d2241e-0214-4558-82b1-2f125646ecce req-17692e59-159b-4d93-b3e9-6b92afc6bfa9 service nova] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-56d2241e-0214-4558-82b1-2f125646ecce req-17692e59-159b-4d93-b3e9-6b92afc6bfa9 service nova] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-56d2241e-0214-4558-82b1-2f125646ecce req-17692e59-159b-4d93-b3e9-6b92afc6bfa9 service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] No waiting events found dispatching network-vif-plugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:32:06 user nova-compute[74587]: WARNING nova.compute.manager [req-56d2241e-0214-4558-82b1-2f125646ecce req-17692e59-159b-4d93-b3e9-6b92afc6bfa9 service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received unexpected event network-vif-plugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 for instance with vm_state building and task_state spawning.
Oct 18 07:32:06 user nova-compute[74587]: INFO nova.compute.manager [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Took 5.54 seconds to spawn the instance on the hypervisor.
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:32:06 user nova-compute[74587]: INFO nova.compute.manager [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Took 6.37 seconds to build instance.
Oct 18 07:32:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c265b517-5ced-427e-b760-05269ac20c9e tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.469s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:06 user nova-compute[74587]: INFO nova.compute.manager [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Terminating instance
Oct 18 07:32:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-b8cd3a48-9944-45d8-9faa-d2b6c806c9ac req-86763137-10b6-44ed-ac5f-f06acaadf13e service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received event network-vif-unplugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b8cd3a48-9944-45d8-9faa-d2b6c806c9ac req-86763137-10b6-44ed-ac5f-f06acaadf13e service nova] Acquiring lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b8cd3a48-9944-45d8-9faa-d2b6c806c9ac req-86763137-10b6-44ed-ac5f-f06acaadf13e service nova] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b8cd3a48-9944-45d8-9faa-d2b6c806c9ac req-86763137-10b6-44ed-ac5f-f06acaadf13e service nova] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-b8cd3a48-9944-45d8-9faa-d2b6c806c9ac req-86763137-10b6-44ed-ac5f-f06acaadf13e service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] No waiting events found dispatching network-vif-unplugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-b8cd3a48-9944-45d8-9faa-d2b6c806c9ac req-86763137-10b6-44ed-ac5f-f06acaadf13e service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received event network-vif-unplugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Instance destroyed successfully.
Oct 18 07:32:07 user nova-compute[74587]: DEBUG nova.objects.instance [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lazy-loading 'resources' on Instance uuid 16088b21-6f4c-4bb5-82e4-51946f015ffd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-192360483',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-192360483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1923604',id=34,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVuxU8Sx7b5ErQemraYdmJrDDBZvX6nosdW3OmVse75x7l52vWgfjWHuEMdFRznErmXgNXcBgAn5PI3MOLmIl7DbRlPHZ7iIOAFvIbz39JxUWVvmyembLPM5tbglqs1Rg==',key_name='tempest-keypair-1258510081',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:28:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='100753d7cc0347f880d9e22fe1e17243',ramdisk_id='',reservation_id='r-bglf6mhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-273184500',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:28:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a52acb7a2a064b5dace4f4601efb26bd',uuid=16088b21-6f4c-4bb5-82e4-51946f015ffd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Converting VIF {"id": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "address": "fa:16:3e:80:91:17", "network": {"id": "4b83d1bf-e592-4623-83f2-6141e8a7fd2e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1391110901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100753d7cc0347f880d9e22fe1e17243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4d296c-11", "ovs_interfaceid": "9b4d296c-113e-48e2-a7f7-b18127f93fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:91:17,bridge_name='br-int',has_traffic_filtering=True,id=9b4d296c-113e-48e2-a7f7-b18127f93fc0,network=Network(4b83d1bf-e592-4623-83f2-6141e8a7fd2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4d296c-11') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG os_vif [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:91:17,bridge_name='br-int',has_traffic_filtering=True,id=9b4d296c-113e-48e2-a7f7-b18127f93fc0,network=Network(4b83d1bf-e592-4623-83f2-6141e8a7fd2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4d296c-11') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b4d296c-11, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45daa1f5-4f75-46e2-9cfc-db60d9314c48) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:32:07 user nova-compute[74587]: INFO os_vif [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:91:17,bridge_name='br-int',has_traffic_filtering=True,id=9b4d296c-113e-48e2-a7f7-b18127f93fc0,network=Network(4b83d1bf-e592-4623-83f2-6141e8a7fd2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4d296c-11')
Oct 18 07:32:07 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Deleting instance files /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd_del
Oct 18 07:32:07 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Deletion of /opt/stack/data/nova/instances/16088b21-6f4c-4bb5-82e4-51946f015ffd_del complete
Oct 18 07:32:07 user nova-compute[74587]: INFO nova.compute.manager [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 18 07:32:07 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:32:07 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:32:08 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:32:08 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Took 0.87 seconds to deallocate network for instance.
Oct 18 07:32:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-f1237dd3-5afa-4483-8721-a6b317f09bb8 req-3cd9e5cc-9fbc-4537-b64d-cfa14fd7ce04 service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received event network-vif-deleted-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:08 user nova-compute[74587]: INFO nova.compute.manager [req-f1237dd3-5afa-4483-8721-a6b317f09bb8 req-3cd9e5cc-9fbc-4537-b64d-cfa14fd7ce04 service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Neutron deleted interface 9b4d296c-113e-48e2-a7f7-b18127f93fc0; detaching it from the instance and deleting it from the info cache
Oct 18 07:32:08 user nova-compute[74587]: DEBUG nova.network.neutron [req-f1237dd3-5afa-4483-8721-a6b317f09bb8 req-3cd9e5cc-9fbc-4537-b64d-cfa14fd7ce04 service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:32:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-f1237dd3-5afa-4483-8721-a6b317f09bb8 req-3cd9e5cc-9fbc-4537-b64d-cfa14fd7ce04 service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Detach interface failed, port_id=9b4d296c-113e-48e2-a7f7-b18127f93fc0, reason: Instance 16088b21-6f4c-4bb5-82e4-51946f015ffd could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:32:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:09 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:32:09 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:32:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:09 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Deleted allocations for instance 16088b21-6f4c-4bb5-82e4-51946f015ffd
Oct 18 07:32:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-447d0f0d-e382-4307-bba7-72b4cd091b6e tempest-TestServerVolumeAttachScenarioOldVersion-273184500 tempest-TestServerVolumeAttachScenarioOldVersion-273184500-project-member] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-d2f1b7d6-48b1-4f9e-9c0b-369f26a661fb req-22b28485-be26-454b-8cd2-a028241a635f service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received event network-vif-plugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d2f1b7d6-48b1-4f9e-9c0b-369f26a661fb req-22b28485-be26-454b-8cd2-a028241a635f service nova] Acquiring lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d2f1b7d6-48b1-4f9e-9c0b-369f26a661fb req-22b28485-be26-454b-8cd2-a028241a635f service nova] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d2f1b7d6-48b1-4f9e-9c0b-369f26a661fb req-22b28485-be26-454b-8cd2-a028241a635f service nova] Lock "16088b21-6f4c-4bb5-82e4-51946f015ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-d2f1b7d6-48b1-4f9e-9c0b-369f26a661fb req-22b28485-be26-454b-8cd2-a028241a635f service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] No waiting events found dispatching network-vif-plugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:32:09 user nova-compute[74587]: WARNING nova.compute.manager [req-d2f1b7d6-48b1-4f9e-9c0b-369f26a661fb req-22b28485-be26-454b-8cd2-a028241a635f service nova] [instance: 16088b21-6f4c-4bb5-82e4-51946f015ffd] Received unexpected event network-vif-plugged-9b4d296c-113e-48e2-a7f7-b18127f93fc0 for instance with vm_state deleted and task_state None.
Oct 18 07:32:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "665a2f6d-4704-400e-aeca-ae8cb29333da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:15 user nova-compute[74587]: INFO nova.compute.manager [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Terminating instance
Oct 18 07:32:15 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-5211fac7-ca4c-47e9-8310-8fb5a023bfed req-11f5ab6c-e0ed-4863-a3fb-0da9de5ebd8f service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Received event network-vif-unplugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5211fac7-ca4c-47e9-8310-8fb5a023bfed req-11f5ab6c-e0ed-4863-a3fb-0da9de5ebd8f service nova] Acquiring lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5211fac7-ca4c-47e9-8310-8fb5a023bfed req-11f5ab6c-e0ed-4863-a3fb-0da9de5ebd8f service nova] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5211fac7-ca4c-47e9-8310-8fb5a023bfed req-11f5ab6c-e0ed-4863-a3fb-0da9de5ebd8f service nova] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-5211fac7-ca4c-47e9-8310-8fb5a023bfed req-11f5ab6c-e0ed-4863-a3fb-0da9de5ebd8f service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] No waiting events found dispatching network-vif-unplugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-5211fac7-ca4c-47e9-8310-8fb5a023bfed req-11f5ab6c-e0ed-4863-a3fb-0da9de5ebd8f service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Received event network-vif-unplugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:32:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Instance destroyed successfully.
Oct 18 07:32:15 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lazy-loading 'resources' on Instance uuid 665a2f6d-4704-400e-aeca-ae8cb29333da {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-958590571',display_name='tempest-ServersNegativeTestJSON-server-958590571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-958590571',id=28,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:23:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e52872350444fd954e9fea9743b118',ramdisk_id='',reservation_id='r-2m852wxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-766120743',owner_user_name='tempest-ServersNegativeTestJSON-766120743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:23:17Z,user_data=None,user_id='968bb444a9524dab94f28aa7ffab2305',uuid=665a2f6d-4704-400e-aeca-ae8cb29333da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converting VIF {"id": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "address": "fa:16:3e:3c:47:37", "network": {"id": "fd229a78-e51a-4a05-8f60-ee7ebbf7bc36", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-142568359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e52872350444fd954e9fea9743b118", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4efaf64a-1e", "ovs_interfaceid": "4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:47:37,bridge_name='br-int',has_traffic_filtering=True,id=4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4efaf64a-1e') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG os_vif [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:47:37,bridge_name='br-int',has_traffic_filtering=True,id=4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4efaf64a-1e') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4efaf64a-1e, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9053e85e-e03a-4626-8576-f44c0600a091) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:32:15 user nova-compute[74587]: INFO os_vif [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:47:37,bridge_name='br-int',has_traffic_filtering=True,id=4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c,network=Network(fd229a78-e51a-4a05-8f60-ee7ebbf7bc36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4efaf64a-1e')
Oct 18 07:32:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Deleting instance files /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da_del
Oct 18 07:32:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Deletion of /opt/stack/data/nova/instances/665a2f6d-4704-400e-aeca-ae8cb29333da_del complete
Oct 18 07:32:16 user nova-compute[74587]: INFO nova.compute.manager [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 18 07:32:16 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:32:16 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:32:16 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:32:16 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:32:16 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Took 0.60 seconds to deallocate network for instance.
Oct 18 07:32:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-ea7fe6ef-0884-49a2-9e2a-eb27e1692b43 req-ff66a132-36ed-4997-bef6-b9b13ca5a26c service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Received event network-vif-deleted-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:16 user nova-compute[74587]: INFO nova.compute.manager [req-ea7fe6ef-0884-49a2-9e2a-eb27e1692b43 req-ff66a132-36ed-4997-bef6-b9b13ca5a26c service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Neutron deleted interface 4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c; detaching it from the instance and deleting it from the info cache
Oct 18 07:32:16 user nova-compute[74587]: DEBUG nova.network.neutron [req-ea7fe6ef-0884-49a2-9e2a-eb27e1692b43 req-ff66a132-36ed-4997-bef6-b9b13ca5a26c service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:32:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-ea7fe6ef-0884-49a2-9e2a-eb27e1692b43 req-ff66a132-36ed-4997-bef6-b9b13ca5a26c service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Detach interface failed, port_id=4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c, reason: Instance 665a2f6d-4704-400e-aeca-ae8cb29333da could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:32:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:16 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:32:16 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:32:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:16 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Deleted allocations for instance 665a2f6d-4704-400e-aeca-ae8cb29333da
Oct 18 07:32:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3533da2c-0ebd-413d-99e2-4cf2fc2c9c66 tempest-ServersNegativeTestJSON-766120743 tempest-ServersNegativeTestJSON-766120743-project-member] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.903s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-7e096015-83c9-4a3a-8f8d-d9273bb9f6ae req-eba6d1e4-4c2f-4180-a1c0-d42fe9526bbb service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Received event network-vif-plugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7e096015-83c9-4a3a-8f8d-d9273bb9f6ae req-eba6d1e4-4c2f-4180-a1c0-d42fe9526bbb service nova] Acquiring lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7e096015-83c9-4a3a-8f8d-d9273bb9f6ae req-eba6d1e4-4c2f-4180-a1c0-d42fe9526bbb service nova] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7e096015-83c9-4a3a-8f8d-d9273bb9f6ae req-eba6d1e4-4c2f-4180-a1c0-d42fe9526bbb service nova] Lock "665a2f6d-4704-400e-aeca-ae8cb29333da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-7e096015-83c9-4a3a-8f8d-d9273bb9f6ae req-eba6d1e4-4c2f-4180-a1c0-d42fe9526bbb service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] No waiting events found dispatching network-vif-plugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:32:17 user nova-compute[74587]: WARNING nova.compute.manager [req-7e096015-83c9-4a3a-8f8d-d9273bb9f6ae req-eba6d1e4-4c2f-4180-a1c0-d42fe9526bbb service nova] [instance: 665a2f6d-4704-400e-aeca-ae8cb29333da] Received unexpected event network-vif-plugged-4efaf64a-1efa-4a0e-a3fa-779fdc7adb3c for instance with vm_state deleted and task_state None.
Oct 18 07:32:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:32:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:21 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:32:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:32:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:32:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:32:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:32:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:32:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:32:31 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:32:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:32:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:32:31 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: bb153556-57ca-4401-894a-e3588a05e460] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:32:31 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating instance_info_cache with network_info: [{"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:32:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-bb153556-57ca-4401-894a-e3588a05e460" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:32:31 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:32:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:33 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:32:33 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:32:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8182MB free_disk=25.287025451660156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance bb153556-57ca-4401-894a-e3588a05e460 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 79f2ca30-3797-41a4-bbb2-3431bedbf8f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 03838929-5ebc-4590-98e4-0b8dfa6d4570 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:32:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:32:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:32:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "bb153556-57ca-4401-894a-e3588a05e460" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:56 user nova-compute[74587]: INFO nova.compute.manager [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Terminating instance
Oct 18 07:32:56 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-a4fbbf25-a6c1-4bcf-9881-acb417b7ca30 req-8545b886-6120-43fc-a45d-20c330dafe31 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-vif-unplugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a4fbbf25-a6c1-4bcf-9881-acb417b7ca30 req-8545b886-6120-43fc-a45d-20c330dafe31 service nova] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a4fbbf25-a6c1-4bcf-9881-acb417b7ca30 req-8545b886-6120-43fc-a45d-20c330dafe31 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a4fbbf25-a6c1-4bcf-9881-acb417b7ca30 req-8545b886-6120-43fc-a45d-20c330dafe31 service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-a4fbbf25-a6c1-4bcf-9881-acb417b7ca30 req-8545b886-6120-43fc-a45d-20c330dafe31 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] No waiting events found dispatching network-vif-unplugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-a4fbbf25-a6c1-4bcf-9881-acb417b7ca30 req-8545b886-6120-43fc-a45d-20c330dafe31 service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-vif-unplugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:56 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: bb153556-57ca-4401-894a-e3588a05e460] Instance destroyed successfully.
Oct 18 07:32:56 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'resources' on Instance uuid bb153556-57ca-4401-894a-e3588a05e460 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:26:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1974074510',display_name='tempest-ServerActionsTestOtherA-server-1974074510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1974074510',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA52QLTWvy/v2jV8SnvcFET/QtPPTqG94sHIUJ+eIA4fj3Aw4bOkxeUXjNyfaIA0FLk6wcOPrhSmuqIwPWgig8KHxvH3mp04gQBlQsoVn3vpHBaDRDx2a25MshLKHMkpQ==',key_name='tempest-keypair-952803272',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:28:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-9tmk55cz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=bb153556-57ca-4401-894a-e3588a05e460,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "address": "fa:16:3e:68:56:dd", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2a831-ec", "ovs_interfaceid": "e6c2a831-ec15-4209-82ee-ebfdea1813fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG os_vif [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6c2a831-ec, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b7af8f2-369e-4992-a3b2-a46142034563) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:32:56 user nova-compute[74587]: INFO os_vif [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=e6c2a831-ec15-4209-82ee-ebfdea1813fa,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2a831-ec')
Oct 18 07:32:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glFnWiTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:32:56 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:32:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b359d77f-4869-4548-880d-3edd6ac2ed3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:32:56 user nova-compute[74587]: No targets found.
Oct 18 07:32:56 user nova-compute[74587]: iSNS:
Oct 18 07:32:56 user nova-compute[74587]: No targets found.
Oct 18 07:32:56 user nova-compute[74587]: STATIC:
Oct 18 07:32:56 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039
Oct 18 07:32:56 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:32:56 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:32:56 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740
Oct 18 07:32:56 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:32:56 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:32:56 user nova-compute[74587]: FIRMWARE:
Oct 18 07:32:56 user nova-compute[74587]: No targets found.
Oct 18 07:32:56 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:32:56 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:32:56 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dddefe-37ae-4afe-83f3-db1ad420dfb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:32:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b4ca66-8eba-4be8-879e-70e14d0e7941]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:32:57 user nova-compute[74587]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:32:57 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 (non-flash)
Oct 18 07:32:57 user nova-compute[74587]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:32:57 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10082be290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02122cb-cc07-4877-9f46-7df8263933ab]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fb53e2-118e-4bce-ac7f-34cf71b41401]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1c2475-059e-4a84-9671-ce68a3dbad37]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ced762-de8a-44e1-8a03-79709cc08fc1]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eee402-0ba7-443b-8c3b-aa0d3b0bc7ac]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[968141ef-6e46-443d-a89f-5d14c9e63f44]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260]
Oct 18 07:32:57 user nova-compute[74587]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039, portal: 172.16.0.220,3260] successful.
Oct 18 07:32:57 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d811b23-c02f-433f-99ea-ea4bd3426039 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65ea44f-a625-4632-8dea-ee382bcc76e5]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] <== disconnect_volume: return (347ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:32:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Deleting instance files /opt/stack/data/nova/instances/bb153556-57ca-4401-894a-e3588a05e460_del
Oct 18 07:32:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Deletion of /opt/stack/data/nova/instances/bb153556-57ca-4401-894a-e3588a05e460_del complete
Oct 18 07:32:57 user nova-compute[74587]: INFO nova.compute.manager [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 18 07:32:57 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: bb153556-57ca-4401-894a-e3588a05e460] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: bb153556-57ca-4401-894a-e3588a05e460] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:32:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:32:58 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: bb153556-57ca-4401-894a-e3588a05e460] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:32:58 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: bb153556-57ca-4401-894a-e3588a05e460] Took 0.93 seconds to deallocate network for instance.
Oct 18 07:32:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-60e19117-6e17-4cd2-9595-c70662e92171 req-fa2ac492-77de-4c1d-b3a9-cc6919bef0ac service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-60e19117-6e17-4cd2-9595-c70662e92171 req-fa2ac492-77de-4c1d-b3a9-cc6919bef0ac service nova] Acquiring lock "bb153556-57ca-4401-894a-e3588a05e460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-60e19117-6e17-4cd2-9595-c70662e92171 req-fa2ac492-77de-4c1d-b3a9-cc6919bef0ac service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-60e19117-6e17-4cd2-9595-c70662e92171 req-fa2ac492-77de-4c1d-b3a9-cc6919bef0ac service nova] Lock "bb153556-57ca-4401-894a-e3588a05e460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-60e19117-6e17-4cd2-9595-c70662e92171 req-fa2ac492-77de-4c1d-b3a9-cc6919bef0ac service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] No waiting events found dispatching network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:32:58 user nova-compute[74587]: WARNING nova.compute.manager [req-60e19117-6e17-4cd2-9595-c70662e92171 req-fa2ac492-77de-4c1d-b3a9-cc6919bef0ac service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received unexpected event network-vif-plugged-e6c2a831-ec15-4209-82ee-ebfdea1813fa for instance with vm_state active and task_state deleting.
Oct 18 07:32:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-60e19117-6e17-4cd2-9595-c70662e92171 req-fa2ac492-77de-4c1d-b3a9-cc6919bef0ac service nova] [instance: bb153556-57ca-4401-894a-e3588a05e460] Received event network-vif-deleted-e6c2a831-ec15-4209-82ee-ebfdea1813fa {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:59 user nova-compute[74587]: INFO nova.compute.manager [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Took 0.93 seconds to detach 1 volumes for instance.
Oct 18 07:32:59 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: bb153556-57ca-4401-894a-e3588a05e460] Deleting volume: 3d811b23-c02f-433f-99ea-ea4bd3426039 {{(pid=74587) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 07:32:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-a5733e6a-6d9b-42c6-8a80-6201447cfcb2 req-31bdee07-a715-47eb-8e8d-49e901320fa2 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received event network-changed-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:32:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-a5733e6a-6d9b-42c6-8a80-6201447cfcb2 req-31bdee07-a715-47eb-8e8d-49e901320fa2 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Refreshing instance network info cache due to event network-changed-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:32:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a5733e6a-6d9b-42c6-8a80-6201447cfcb2 req-31bdee07-a715-47eb-8e8d-49e901320fa2 service nova] Acquiring lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:32:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a5733e6a-6d9b-42c6-8a80-6201447cfcb2 req-31bdee07-a715-47eb-8e8d-49e901320fa2 service nova] Acquired lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:32:59 user nova-compute[74587]: DEBUG nova.network.neutron [req-a5733e6a-6d9b-42c6-8a80-6201447cfcb2 req-31bdee07-a715-47eb-8e8d-49e901320fa2 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Refreshing network info cache for port 96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:32:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:32:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:32:59 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:32:59 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:32:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:32:59 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Deleted allocations for instance bb153556-57ca-4401-894a-e3588a05e460
Oct 18 07:32:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4fa04446-f6b8-427b-a887-bb029bbeb482 tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "bb153556-57ca-4401-894a-e3588a05e460" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.802s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:00 user nova-compute[74587]: DEBUG nova.network.neutron [req-a5733e6a-6d9b-42c6-8a80-6201447cfcb2 req-31bdee07-a715-47eb-8e8d-49e901320fa2 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updated VIF entry in instance network info cache for port 96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:33:00 user nova-compute[74587]: DEBUG nova.network.neutron [req-a5733e6a-6d9b-42c6-8a80-6201447cfcb2 req-31bdee07-a715-47eb-8e8d-49e901320fa2 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updating instance_info_cache with network_info: [{"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a5733e6a-6d9b-42c6-8a80-6201447cfcb2 req-31bdee07-a715-47eb-8e8d-49e901320fa2 service nova] Releasing lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "7df5792a-005a-49b9-856f-7758869917fd" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:14 user nova-compute[74587]: INFO nova.compute.manager [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Unshelving
Oct 18 07:33:14 user nova-compute[74587]: INFO nova.virt.block_device [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Booting with volume e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 at /dev/vda
Oct 18 07:33:14 user nova-compute[74587]: DEBUG os_brick.utils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:33:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:14 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[36549f25-ac5f-4b20-8048-6368c545e958]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab504561-63bf-454f-ac2e-a7529f22f753]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ed441f-48cc-4eae-82f4-a385fb2814c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9719e7a-c116-44b2-9be9-6bba28711c63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:33:15 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:33:15 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3e2863-282a-46af-9edf-1fba6ab725f3]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG os_brick.utils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:33:15 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating existing volume attachment record: c22c2618-4730-4407-8847-1682e269b1cf {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:33:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "effe554a-aceb-459e-a45c-6b0a203f8553" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "effe554a-aceb-459e-a45c-6b0a203f8553" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:33:17 user nova-compute[74587]: INFO nova.compute.claims [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Claim successful on node user
Oct 18 07:33:17 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:33:17 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:33:17 user nova-compute[74587]: DEBUG nova.compute.manager [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG nova.policy [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd13de789e98e4ba9ad22d665ff8e4ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cfa00773ba4c5498c56b84ccb307a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:33:17 user nova-compute[74587]: INFO nova.virt.block_device [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Booting with volume 98dd3b2e-6ddf-42f2-9e39-a36e9236da62 at /dev/vda
Oct 18 07:33:17 user nova-compute[74587]: DEBUG os_brick.utils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d669ba5-020a-46d2-a216-9927e71ee9a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0635075-260d-4b26-9c51-6f23531e500d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c220b7f9-5aa0-4669-98f2-865a70d99d14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee7230e-3dc1-4e6c-8bde-68dbefdbdf5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:33:17 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:33:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9f57a2-e744-4089-8576-bfb4538c1219]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG os_brick.utils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Updating existing volume attachment record: 01ac08c2-32fc-48b7-bea5-cc4aecc1e7e0 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:33:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:18 user nova-compute[74587]: DEBUG nova.network.neutron [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Successfully created port: f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:33:19 user nova-compute[74587]: DEBUG nova.network.neutron [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Successfully updated port: f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:33:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquired lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:19 user nova-compute[74587]: DEBUG nova.network.neutron [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:33:19 user nova-compute[74587]: DEBUG nova.network.neutron [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:33:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-5b767115-823e-41b1-bee7-9ce312e4be0e req-e541639e-69ef-4bf4-89fe-60020401e214 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received event network-changed-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-5b767115-823e-41b1-bee7-9ce312e4be0e req-e541639e-69ef-4bf4-89fe-60020401e214 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Refreshing instance network info cache due to event network-changed-f187e480-b199-46b5-9915-8964a37ba626. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:33:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5b767115-823e-41b1-bee7-9ce312e4be0e req-e541639e-69ef-4bf4-89fe-60020401e214 service nova] Acquiring lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:20 user nova-compute[74587]: DEBUG nova.network.neutron [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Updating instance_info_cache with network_info: [{"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Releasing lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Instance network_info: |[{"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:33:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5b767115-823e-41b1-bee7-9ce312e4be0e req-e541639e-69ef-4bf4-89fe-60020401e214 service nova] Acquired lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:20 user nova-compute[74587]: DEBUG nova.network.neutron [req-5b767115-823e-41b1-bee7-9ce312e4be0e req-e541639e-69ef-4bf4-89fe-60020401e214 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Refreshing network info cache for port f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:33:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:21 user nova-compute[74587]: DEBUG nova.network.neutron [req-5b767115-823e-41b1-bee7-9ce312e4be0e req-e541639e-69ef-4bf4-89fe-60020401e214 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Updated VIF entry in instance network info cache for port f187e480-b199-46b5-9915-8964a37ba626. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:33:21 user nova-compute[74587]: DEBUG nova.network.neutron [req-5b767115-823e-41b1-bee7-9ce312e4be0e req-e541639e-69ef-4bf4-89fe-60020401e214 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Updating instance_info_cache with network_info: [{"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5b767115-823e-41b1-bee7-9ce312e4be0e req-e541639e-69ef-4bf4-89fe-60020401e214 service nova] Releasing lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:22 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:33:22 user nova-compute[74587]: INFO nova.compute.claims [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Claim successful on node user
Oct 18 07:33:23 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:33:23 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:33:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG nova.policy [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51902e137d224e428fba578e2e535656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35a447ffe7c47b0963dc60edd4b926a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:33:23 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Creating image(s)
Oct 18 07:33:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "/opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "/opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "/opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "59ee723b718f44817c075f9cabc1311fb63a670a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "59ee723b718f44817c075f9cabc1311fb63a670a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a.part --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a.part --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG nova.virt.images [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] 7a6986e6-35b6-48d4-9274-3883bb3d2940 was qcow2, converting to raw {{(pid=74587) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a.part /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a.converted {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Successfully created port: 2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a.part /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a.converted" returned: 0 in 0.420s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a.converted --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "59ee723b718f44817c075f9cabc1311fb63a670a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.353s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a --force-share --output=json" returned: 0 in 0.196s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "59ee723b718f44817c075f9cabc1311fb63a670a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "59ee723b718f44817c075f9cabc1311fb63a670a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Successfully updated port: 2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquired lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a --force-share --output=json" returned: 0 in 0.243s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a,backing_fmt=raw /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-73e5792a-81e0-4479-95c5-f2721420a274 req-15ebe839-0c7d-4410-a666-944308e8f7f4 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-changed-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-73e5792a-81e0-4479-95c5-f2721420a274 req-15ebe839-0c7d-4410-a666-944308e8f7f4 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Refreshing instance network info cache due to event network-changed-2e4c6cdf-26f0-4096-a605-7161eda14b7d. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-73e5792a-81e0-4479-95c5-f2721420a274 req-15ebe839-0c7d-4410-a666-944308e8f7f4 service nova] Acquiring lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a,backing_fmt=raw /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk 1073741824" returned: 0 in 0.217s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "59ee723b718f44817c075f9cabc1311fb63a670a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.463s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Cannot resize image /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Ensure instance console log exists: /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updating instance_info_cache with network_info: [{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Releasing lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Instance network_info: |[{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-73e5792a-81e0-4479-95c5-f2721420a274 req-15ebe839-0c7d-4410-a666-944308e8f7f4 service nova] Acquired lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-73e5792a-81e0-4479-95c5-f2721420a274 req-15ebe839-0c7d-4410-a666-944308e8f7f4 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Refreshing network info cache for port 2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Start _get_guest_xml network_info=[{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:33:19Z,direct_url=<?>,disk_format='qcow2',id=7a6986e6-35b6-48d4-9274-3883bb3d2940,min_disk=0,min_ram=0,name='tempest-scenario-img--1364367311',owner='e35a447ffe7c47b0963dc60edd4b926a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:33:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '7a6986e6-35b6-48d4-9274-3883bb3d2940'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:33:26 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:26 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:33:19Z,direct_url=<?>,disk_format='qcow2',id=7a6986e6-35b6-48d4-9274-3883bb3d2940,min_disk=0,min_ram=0,name='tempest-scenario-img--1364367311',owner='e35a447ffe7c47b0963dc60edd4b926a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:33:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-861854339',display_name='tempest-TestMinimumBasicScenario-server-861854339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-861854339',id=41,image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESO/HS+ngbf9m2R4QevHaLg9eF5LtfqQ/LJiD+Pa2pv6GjsOL27HsCrgWpTrae7xY7SYx9GbA91Xb21TM8prj4ufDJJfXX5LaXtsbKnImomtXI4oBhTWmoqDMrfvcUBJQ==',key_name='tempest-TestMinimumBasicScenario-1418151160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35a447ffe7c47b0963dc60edd4b926a',ramdisk_id='',reservation_id='r-7exmo5di',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-795187138',owner_user_name='tempest-TestMinimumBasicScenario-795187138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:33:23Z,user_data=None,user_id='51902e137d224e428fba578e2e535656',uuid=feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converting VIF {"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.objects.instance [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'pci_devices' on Instance uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:33:26 user nova-compute[74587]:   <uuid>feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599</uuid>
Oct 18 07:33:26 user nova-compute[74587]:   <name>instance-00000029</name>
Oct 18 07:33:26 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:33:26 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:33:26 user nova-compute[74587]:   <metadata>
Oct 18 07:33:26 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:33:26 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:33:26 user nova-compute[74587]:       <nova:name>tempest-TestMinimumBasicScenario-server-861854339</nova:name>
Oct 18 07:33:26 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:33:26</nova:creationTime>
Oct 18 07:33:26 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:33:26 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:33:26 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:33:26 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:33:26 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:33:26 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:33:26 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:33:26 user nova-compute[74587]:       <nova:owner>
Oct 18 07:33:26 user nova-compute[74587]:         <nova:user uuid="51902e137d224e428fba578e2e535656">tempest-TestMinimumBasicScenario-795187138-project-member</nova:user>
Oct 18 07:33:26 user nova-compute[74587]:         <nova:project uuid="e35a447ffe7c47b0963dc60edd4b926a">tempest-TestMinimumBasicScenario-795187138</nova:project>
Oct 18 07:33:26 user nova-compute[74587]:       </nova:owner>
Oct 18 07:33:26 user nova-compute[74587]:       <nova:root type="image" uuid="7a6986e6-35b6-48d4-9274-3883bb3d2940"/>
Oct 18 07:33:26 user nova-compute[74587]:       <nova:ports>
Oct 18 07:33:26 user nova-compute[74587]:         <nova:port uuid="2e4c6cdf-26f0-4096-a605-7161eda14b7d">
Oct 18 07:33:26 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:33:26 user nova-compute[74587]:         </nova:port>
Oct 18 07:33:26 user nova-compute[74587]:       </nova:ports>
Oct 18 07:33:26 user nova-compute[74587]:     </nova:instance>
Oct 18 07:33:26 user nova-compute[74587]:   </metadata>
Oct 18 07:33:26 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:33:26 user nova-compute[74587]:     <system>
Oct 18 07:33:26 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:33:26 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:33:26 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:33:26 user nova-compute[74587]:       <entry name="serial">feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599</entry>
Oct 18 07:33:26 user nova-compute[74587]:       <entry name="uuid">feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599</entry>
Oct 18 07:33:26 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:33:26 user nova-compute[74587]:     </system>
Oct 18 07:33:26 user nova-compute[74587]:   </sysinfo>
Oct 18 07:33:26 user nova-compute[74587]:   <os>
Oct 18 07:33:26 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:33:26 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:33:26 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:33:26 user nova-compute[74587]:   </os>
Oct 18 07:33:26 user nova-compute[74587]:   <features>
Oct 18 07:33:26 user nova-compute[74587]:     <acpi/>
Oct 18 07:33:26 user nova-compute[74587]:     <apic/>
Oct 18 07:33:26 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:33:26 user nova-compute[74587]:   </features>
Oct 18 07:33:26 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:33:26 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:33:26 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:33:26 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:33:26 user nova-compute[74587]:   </clock>
Oct 18 07:33:26 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:33:26 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:33:26 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:33:26 user nova-compute[74587]:   </cpu>
Oct 18 07:33:26 user nova-compute[74587]:   <devices>
Oct 18 07:33:26 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:33:26 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:33:26 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk"/>
Oct 18 07:33:26 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:33:26 user nova-compute[74587]:     </disk>
Oct 18 07:33:26 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:33:26 user nova-compute[74587]:       <mac address="fa:16:3e:09:de:b0"/>
Oct 18 07:33:26 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:33:26 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:33:26 user nova-compute[74587]:       <target dev="tap2e4c6cdf-26"/>
Oct 18 07:33:26 user nova-compute[74587]:     </interface>
Oct 18 07:33:26 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:33:26 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/console.log" append="off"/>
Oct 18 07:33:26 user nova-compute[74587]:     </serial>
Oct 18 07:33:26 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:33:26 user nova-compute[74587]:     <video>
Oct 18 07:33:26 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:33:26 user nova-compute[74587]:     </video>
Oct 18 07:33:26 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:33:26 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:33:26 user nova-compute[74587]:     </rng>
Oct 18 07:33:26 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:33:26 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:33:26 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:33:26 user nova-compute[74587]:     </memballoon>
Oct 18 07:33:26 user nova-compute[74587]:   </devices>
Oct 18 07:33:26 user nova-compute[74587]: </domain>
Oct 18 07:33:26 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-861854339',display_name='tempest-TestMinimumBasicScenario-server-861854339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-861854339',id=41,image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESO/HS+ngbf9m2R4QevHaLg9eF5LtfqQ/LJiD+Pa2pv6GjsOL27HsCrgWpTrae7xY7SYx9GbA91Xb21TM8prj4ufDJJfXX5LaXtsbKnImomtXI4oBhTWmoqDMrfvcUBJQ==',key_name='tempest-TestMinimumBasicScenario-1418151160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35a447ffe7c47b0963dc60edd4b926a',ramdisk_id='',reservation_id='r-7exmo5di',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-795187138',owner_user_name='tempest-TestMinimumBasicScenario-795187138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:33:23Z,user_data=None,user_id='51902e137d224e428fba578e2e535656',uuid=feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converting VIF {"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG os_vif [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dae6c74a-c165-56e4-860f-8410121a4c8e', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e4c6cdf-26, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e4c6cdf-26, col_values=(('qos', UUID('4da67245-2972-4c3a-bbe0-bb5dc33ce2a0')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e4c6cdf-26, col_values=(('external_ids', {'iface-id': '2e4c6cdf-26f0-4096-a605-7161eda14b7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:de:b0', 'vm-uuid': 'feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:26 user nova-compute[74587]: INFO os_vif [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26')
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] No VIF found with MAC fa:16:3e:09:de:b0, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-73e5792a-81e0-4479-95c5-f2721420a274 req-15ebe839-0c7d-4410-a666-944308e8f7f4 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updated VIF entry in instance network info cache for port 2e4c6cdf-26f0-4096-a605-7161eda14b7d. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-73e5792a-81e0-4479-95c5-f2721420a274 req-15ebe839-0c7d-4410-a666-944308e8f7f4 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updating instance_info_cache with network_info: [{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-73e5792a-81e0-4479-95c5-f2721420a274 req-15ebe839-0c7d-4410-a666-944308e8f7f4 service nova] Releasing lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-066416cb-8cae-4fa6-b468-01aead949573 req-e79da346-a157-46a9-82b1-890223324255 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-066416cb-8cae-4fa6-b468-01aead949573 req-e79da346-a157-46a9-82b1-890223324255 service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-066416cb-8cae-4fa6-b468-01aead949573 req-e79da346-a157-46a9-82b1-890223324255 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-066416cb-8cae-4fa6-b468-01aead949573 req-e79da346-a157-46a9-82b1-890223324255 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-066416cb-8cae-4fa6-b468-01aead949573 req-e79da346-a157-46a9-82b1-890223324255 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:28 user nova-compute[74587]: WARNING nova.compute.manager [req-066416cb-8cae-4fa6-b468-01aead949573 req-e79da346-a157-46a9-82b1-890223324255 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state building and task_state spawning.
Oct 18 07:33:28 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-a3ad3042-1281-4283-a23b-986570edf72b req-c8f7bf72-340c-4a1f-80a1-aceb84cdb426 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a3ad3042-1281-4283-a23b-986570edf72b req-c8f7bf72-340c-4a1f-80a1-aceb84cdb426 service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a3ad3042-1281-4283-a23b-986570edf72b req-c8f7bf72-340c-4a1f-80a1-aceb84cdb426 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a3ad3042-1281-4283-a23b-986570edf72b req-c8f7bf72-340c-4a1f-80a1-aceb84cdb426 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-a3ad3042-1281-4283-a23b-986570edf72b req-c8f7bf72-340c-4a1f-80a1-aceb84cdb426 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:30 user nova-compute[74587]: WARNING nova.compute.manager [req-a3ad3042-1281-4283-a23b-986570edf72b req-c8f7bf72-340c-4a1f-80a1-aceb84cdb426 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state building and task_state spawning.
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:33:30 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Instance spawned successfully.
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:30 user nova-compute[74587]: INFO nova.compute.manager [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Took 7.00 seconds to spawn the instance on the hypervisor.
Oct 18 07:33:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:33:30 user nova-compute[74587]: INFO nova.compute.manager [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Took 7.78 seconds to build instance.
Oct 18 07:33:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a7d245b6-d5e7-44a1-bc58-525aec5f4bea tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.896s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:32 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:33:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 18 07:33:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:33:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.objects.instance [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lazy-loading 'pci_requests' on Instance uuid 7df5792a-005a-49b9-856f-7758869917fd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.objects.instance [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lazy-loading 'numa_topology' on Instance uuid 7df5792a-005a-49b9-856f-7758869917fd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:33:34 user nova-compute[74587]: INFO nova.compute.claims [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Claim successful on node user
Oct 18 07:33:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.577s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:33:34 user nova-compute[74587]: INFO nova.compute.claims [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Claim successful on node user
Oct 18 07:33:34 user nova-compute[74587]: INFO nova.network.neutron [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating port 2b4a587e-fda7-4b59-9074-241c0cbfe1d9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.790s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:33:35 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.policy [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8520ff9b3a8141ada3e3d5634762fa1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714315c24629492e94635d69c58bfef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:33:35 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Creating image(s)
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "/opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "/opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquired lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.network.neutron [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-b83284dc-2fd3-455b-b573-ad2e323b9cd4 req-eba5816c-50db-4782-be13-1ee16f144855 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-changed-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG nova.compute.manager [req-b83284dc-2fd3-455b-b573-ad2e323b9cd4 req-eba5816c-50db-4782-be13-1ee16f144855 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Refreshing instance network info cache due to event network-changed-2b4a587e-fda7-4b59-9074-241c0cbfe1d9. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b83284dc-2fd3-455b-b573-ad2e323b9cd4 req-eba5816c-50db-4782-be13-1ee16f144855 service nova] Acquiring lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.223s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.268s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk 1073741824" returned: 0 in 0.100s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.network.neutron [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating instance_info_cache with network_info: [{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Releasing lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:33:36 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Creating image(s)
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Ensure instance console log exists: /opt/stack/data/nova/instances/7df5792a-005a-49b9-856f-7758869917fd/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Start _get_guest_xml network_info=[{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c22c2618-4730-4407-8847-1682e269b1cf', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcYKVTFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7df5792a-005a-49b9-856f-7758869917fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 'serial': 'e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b83284dc-2fd3-455b-b573-ad2e323b9cd4 req-eba5816c-50db-4782-be13-1ee16f144855 service nova] Acquired lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.network.neutron [req-b83284dc-2fd3-455b-b573-ad2e323b9cd4 req-eba5816c-50db-4782-be13-1ee16f144855 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Refreshing network info cache for port 2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:33:36 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:36 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.objects.instance [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7df5792a-005a-49b9-856f-7758869917fd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.objects.base [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Object Instance<7df5792a-005a-49b9-856f-7758869917fd> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcYKVTFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:33:36 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:33:36 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:33:36 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.259s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af32f6c-0092-48b2-8e18-f7653601c020]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:33:36 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[174e3900-253f-4889-ad9e-f9173ee0d350]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59] added
Oct 18 07:33:36 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce36470-9858-4485-a22a-72e9500e37ce]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c0f71e-c89f-4db3-818e-6ceed3175861]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcYKVTFj {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Cannot resize image /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Ensure instance console log exists: /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcYKVTFj" returned: 0 in 0.046s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[19998e5b-644f-4457-b618-779acf898ae0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qcYKVTFj'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[909e39ab-0bda-4d3d-8e4e-0170312d23e2]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[349a5a93-558e-4b07-b9de-1bf8aabdb652]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:33:36 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:33:36 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Successfully created port: 9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51c7d3-5489-4a0e-9a94-f17177f68f70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260]
Oct 18 07:33:36 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260] successful.
Oct 18 07:33:36 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[392d226d-d07f-4075-af03-82da8d6fe500]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[854a6433-91e0-4aae-a452-056edfb1b4ac]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:33:36 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:33:36 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:33:36 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:33:36 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.486s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49f5d40-6d20-41c5-9774-0979b6424ca1]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcYKVTFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.network.neutron [req-b83284dc-2fd3-455b-b573-ad2e323b9cd4 req-eba5816c-50db-4782-be13-1ee16f144855 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updated VIF entry in instance network info cache for port 2b4a587e-fda7-4b59-9074-241c0cbfe1d9. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:33:36 user nova-compute[74587]: DEBUG nova.network.neutron [req-b83284dc-2fd3-455b-b573-ad2e323b9cd4 req-eba5816c-50db-4782-be13-1ee16f144855 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating instance_info_cache with network_info: [{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b83284dc-2fd3-455b-b573-ad2e323b9cd4 req-eba5816c-50db-4782-be13-1ee16f144855 service nova] Releasing lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "071cfc59-d9ec-4641-a3da-6e32454a4f37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:37 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:37 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8374MB free_disk=25.210159301757812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 773850ee-146d-4e76-9096-8dc18e03221f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 79f2ca30-3797-41a4-bbb2-3431bedbf8f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 03838929-5ebc-4590-98e4-0b8dfa6d4570 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (397368dc-ec08-427c-87a9-228e852f6a40): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance effe554a-aceb-459e-a45c-6b0a203f8553 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ea414a0e-7538-4490-8b78-76b852ea4214 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:33:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Creating image(s)
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Did not create local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Ensure instance console log exists: /opt/stack/data/nova/instances/effe554a-aceb-459e-a45c-6b0a203f8553/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Start _get_guest_xml network_info=[{"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '01ac08c2-32fc-48b7-bea5-cc4aecc1e7e0', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNWJcGdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'effe554a-aceb-459e-a45c-6b0a203f8553', 'attached_at': '', 'detached_at': '', 'volume_id': '98dd3b2e-6ddf-42f2-9e39-a36e9236da62', 'serial': '98dd3b2e-6ddf-42f2-9e39-a36e9236da62'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:33:37 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:37 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 071cfc59-d9ec-4641-a3da-6e32454a4f37 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNWJcGdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:33:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.532s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] <== connect_volume: return (1533ms) {'type': 'block', 'scsi_wwn': '26138303030346233', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138303030346233', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.087s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:33:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:33:37 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[73adf6d7-c9d3-45cb-9a90-70f7352853d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:33:37 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-283849704',display_name='tempest-TestShelveInstance-server-283849704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-283849704',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-262530121',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:29:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='341d61f7861f48899f85601e632ed912',ramdisk_id='',reservation_id='r-0u9l9p27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-906083640',owner_user_name='tempest-TestShelveInstance-906083640-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:33:15Z,user_data=None,user_id='f7c61f0efc8d462bb809d0f512914342',uuid=7df5792a-005a-49b9-856f-7758869917fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converting VIF {"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.objects.instance [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lazy-loading 'pci_devices' on Instance uuid 7df5792a-005a-49b9-856f-7758869917fd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cea8f96-be15-4c48-9dad-6b2c53f7ea3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62] added
Oct 18 07:33:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.objects.base [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Object Instance<7df5792a-005a-49b9-856f-7758869917fd> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:33:37 user nova-compute[74587]:   <uuid>7df5792a-005a-49b9-856f-7758869917fd</uuid>
Oct 18 07:33:37 user nova-compute[74587]:   <name>instance-00000025</name>
Oct 18 07:33:37 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:33:37 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:33:37 user nova-compute[74587]:   <metadata>
Oct 18 07:33:37 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:33:37 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:33:37 user nova-compute[74587]:       <nova:name>tempest-TestShelveInstance-server-283849704</nova:name>
Oct 18 07:33:37 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:33:36</nova:creationTime>
Oct 18 07:33:37 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:33:37 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:33:37 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:33:37 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:33:37 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:33:37 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:33:37 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:33:37 user nova-compute[74587]:       <nova:owner>
Oct 18 07:33:37 user nova-compute[74587]:         <nova:user uuid="f7c61f0efc8d462bb809d0f512914342">tempest-TestShelveInstance-906083640-project-member</nova:user>
Oct 18 07:33:37 user nova-compute[74587]:         <nova:project uuid="341d61f7861f48899f85601e632ed912">tempest-TestShelveInstance-906083640</nova:project>
Oct 18 07:33:37 user nova-compute[74587]:       </nova:owner>
Oct 18 07:33:37 user nova-compute[74587]:       <nova:ports>
Oct 18 07:33:37 user nova-compute[74587]:         <nova:port uuid="2b4a587e-fda7-4b59-9074-241c0cbfe1d9">
Oct 18 07:33:37 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 07:33:37 user nova-compute[74587]:         </nova:port>
Oct 18 07:33:37 user nova-compute[74587]:       </nova:ports>
Oct 18 07:33:37 user nova-compute[74587]:     </nova:instance>
Oct 18 07:33:37 user nova-compute[74587]:   </metadata>
Oct 18 07:33:37 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:33:37 user nova-compute[74587]:     <system>
Oct 18 07:33:37 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:33:37 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:33:37 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:33:37 user nova-compute[74587]:       <entry name="serial">7df5792a-005a-49b9-856f-7758869917fd</entry>
Oct 18 07:33:37 user nova-compute[74587]:       <entry name="uuid">7df5792a-005a-49b9-856f-7758869917fd</entry>
Oct 18 07:33:37 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:33:37 user nova-compute[74587]:     </system>
Oct 18 07:33:37 user nova-compute[74587]:   </sysinfo>
Oct 18 07:33:37 user nova-compute[74587]:   <os>
Oct 18 07:33:37 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:33:37 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:33:37 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:33:37 user nova-compute[74587]:   </os>
Oct 18 07:33:37 user nova-compute[74587]:   <features>
Oct 18 07:33:37 user nova-compute[74587]:     <acpi/>
Oct 18 07:33:37 user nova-compute[74587]:     <apic/>
Oct 18 07:33:37 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:33:37 user nova-compute[74587]:   </features>
Oct 18 07:33:37 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:33:37 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:33:37 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:33:37 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:33:37 user nova-compute[74587]:   </clock>
Oct 18 07:33:37 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:33:37 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:33:37 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:33:37 user nova-compute[74587]:   </cpu>
Oct 18 07:33:37 user nova-compute[74587]:   <devices>
Oct 18 07:33:37 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:33:37 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:33:37 user nova-compute[74587]:       <source dev="/dev/sdb"/>
Oct 18 07:33:37 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:33:37 user nova-compute[74587]:       <serial>e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59</serial>
Oct 18 07:33:37 user nova-compute[74587]:     </disk>
Oct 18 07:33:37 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:33:37 user nova-compute[74587]:       <mac address="fa:16:3e:8e:48:35"/>
Oct 18 07:33:37 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:33:37 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:33:37 user nova-compute[74587]:       <target dev="tap2b4a587e-fd"/>
Oct 18 07:33:37 user nova-compute[74587]:     </interface>
Oct 18 07:33:37 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:33:37 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/7df5792a-005a-49b9-856f-7758869917fd/console.log" append="off"/>
Oct 18 07:33:37 user nova-compute[74587]:     </serial>
Oct 18 07:33:37 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:33:37 user nova-compute[74587]:     <video>
Oct 18 07:33:37 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:33:37 user nova-compute[74587]:     </video>
Oct 18 07:33:37 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:33:37 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:33:37 user nova-compute[74587]:     </rng>
Oct 18 07:33:37 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:33:37 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:33:37 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:33:37 user nova-compute[74587]:     </memballoon>
Oct 18 07:33:37 user nova-compute[74587]:   </devices>
Oct 18 07:33:37 user nova-compute[74587]: </domain>
Oct 18 07:33:37 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-283849704',display_name='tempest-TestShelveInstance-server-283849704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-283849704',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-262530121',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:29:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='341d61f7861f48899f85601e632ed912',ramdisk_id='',reservation_id='r-0u9l9p27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-906083640',owner_user_name='tempest-TestShelveInstance-906083640-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:33:15Z,user_data=None,user_id='f7c61f0efc8d462bb809d0f512914342',uuid=7df5792a-005a-49b9-856f-7758869917fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converting VIF {"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_vif [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f97c2eb5-f94e-536e-8f95-ac918c9bfe52', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d932c58-3cb9-4368-97c4-80c6e49a07b9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b4a587e-fd, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b4a587e-fd, col_values=(('qos', UUID('4321389d-4df1-4ffd-bed4-44dcced8f72e')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b4a587e-fd, col_values=(('external_ids', {'iface-id': '2b4a587e-fda7-4b59-9074-241c0cbfe1d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:48:35', 'vm-uuid': '7df5792a-005a-49b9-856f-7758869917fd'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:37 user nova-compute[74587]: INFO os_vif [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd')
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0054c2-762a-4945-be87-71972b98e7b7]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNWJcGdu {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNWJcGdu" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[183c9b3c-0856-42f4-a579-528843f2744f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNWJcGdu'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f267d81e-15f9-4727-a287-4e4b33c34e13]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] No VIF found with MAC fa:16:3e:8e:48:35, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03e1e61-37ad-4ae4-bf7d-ba2320c392cf]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:33:38 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:33:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:33:38 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:33:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.455s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:33:38 user nova-compute[74587]: INFO nova.compute.claims [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Claim successful on node user
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b34b76-7517-4417-9b1a-18c1d57d9724]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62, portal: 172.16.0.220,3260]
Oct 18 07:33:38 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62, portal: 172.16.0.220,3260] successful.
Oct 18 07:33:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[57db4df9-210e-472c-bb44-09037cc3cceb]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Successfully updated port: 9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d432a326-f934-4cff-90ab-5fb918dd1e42]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:33:38 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:33:38 user nova-compute[74587]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)
Oct 18 07:33:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:33:38 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:33:38 user nova-compute[74587]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)
Oct 18 07:33:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquired lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ba3e2d-e2f2-484d-a48a-665c48485546]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNWJcGdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.compute.manager [req-83e9da62-1eda-4bdb-b888-51bd769c4101 req-3aca8c10-57a5-4ce4-9fcf-46d2f9be6e3d service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received event network-changed-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.compute.manager [req-83e9da62-1eda-4bdb-b888-51bd769c4101 req-3aca8c10-57a5-4ce4-9fcf-46d2f9be6e3d service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Refreshing instance network info cache due to event network-changed-9cff095f-7779-4f55-994c-1d42901b058f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-83e9da62-1eda-4bdb-b888-51bd769c4101 req-3aca8c10-57a5-4ce4-9fcf-46d2f9be6e3d service nova] Acquiring lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updating instance_info_cache with network_info: [{"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Releasing lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Instance network_info: |[{"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-83e9da62-1eda-4bdb-b888-51bd769c4101 req-3aca8c10-57a5-4ce4-9fcf-46d2f9be6e3d service nova] Acquired lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.network.neutron [req-83e9da62-1eda-4bdb-b888-51bd769c4101 req-3aca8c10-57a5-4ce4-9fcf-46d2f9be6e3d service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Refreshing network info cache for port 9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Start _get_guest_xml network_info=[{"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:33:38 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:38 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1428891446',display_name='tempest-TestStampPattern-server-1428891446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1428891446',id=42,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCxWuTJ10c+whHcAUpDfDNeTRwFlH5W1d/E8jb2I/XpDzX51kKsRG9V2bdqFirsQKd0oQnenCerfZEhS8i1Eb78bX6HxHRaCTcnTxEjfRe5Q0diM4h1ECItqYcDOFplGQ==',key_name='tempest-TestStampPattern-794720162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='714315c24629492e94635d69c58bfef0',ramdisk_id='',reservation_id='r-8t7o0ocb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-145299941',owner_user_name='tempest-TestStampPattern-145299941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:33:35Z,user_data=None,user_id='8520ff9b3a8141ada3e3d5634762fa1b',uuid=ea414a0e-7538-4490-8b78-76b852ea4214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converting VIF {"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f9:46,bridge_name='br-int',has_traffic_filtering=True,id=9cff095f-7779-4f55-994c-1d42901b058f,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cff095f-77') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.objects.instance [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lazy-loading 'pci_devices' on Instance uuid ea414a0e-7538-4490-8b78-76b852ea4214 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:33:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:33:38 user nova-compute[74587]:   <uuid>ea414a0e-7538-4490-8b78-76b852ea4214</uuid>
Oct 18 07:33:38 user nova-compute[74587]:   <name>instance-0000002a</name>
Oct 18 07:33:38 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:33:38 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:33:38 user nova-compute[74587]:   <metadata>
Oct 18 07:33:38 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:33:38 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:33:38 user nova-compute[74587]:       <nova:name>tempest-TestStampPattern-server-1428891446</nova:name>
Oct 18 07:33:38 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:33:38</nova:creationTime>
Oct 18 07:33:38 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:33:38 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:33:38 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:33:38 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:33:38 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:33:38 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:33:38 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:33:38 user nova-compute[74587]:       <nova:owner>
Oct 18 07:33:38 user nova-compute[74587]:         <nova:user uuid="8520ff9b3a8141ada3e3d5634762fa1b">tempest-TestStampPattern-145299941-project-member</nova:user>
Oct 18 07:33:38 user nova-compute[74587]:         <nova:project uuid="714315c24629492e94635d69c58bfef0">tempest-TestStampPattern-145299941</nova:project>
Oct 18 07:33:38 user nova-compute[74587]:       </nova:owner>
Oct 18 07:33:38 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:33:38 user nova-compute[74587]:       <nova:ports>
Oct 18 07:33:38 user nova-compute[74587]:         <nova:port uuid="9cff095f-7779-4f55-994c-1d42901b058f">
Oct 18 07:33:38 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 07:33:38 user nova-compute[74587]:         </nova:port>
Oct 18 07:33:38 user nova-compute[74587]:       </nova:ports>
Oct 18 07:33:38 user nova-compute[74587]:     </nova:instance>
Oct 18 07:33:38 user nova-compute[74587]:   </metadata>
Oct 18 07:33:38 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:33:38 user nova-compute[74587]:     <system>
Oct 18 07:33:38 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:33:38 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:33:38 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:33:38 user nova-compute[74587]:       <entry name="serial">ea414a0e-7538-4490-8b78-76b852ea4214</entry>
Oct 18 07:33:38 user nova-compute[74587]:       <entry name="uuid">ea414a0e-7538-4490-8b78-76b852ea4214</entry>
Oct 18 07:33:38 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:33:38 user nova-compute[74587]:     </system>
Oct 18 07:33:38 user nova-compute[74587]:   </sysinfo>
Oct 18 07:33:38 user nova-compute[74587]:   <os>
Oct 18 07:33:38 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:33:38 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:33:38 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:33:38 user nova-compute[74587]:   </os>
Oct 18 07:33:38 user nova-compute[74587]:   <features>
Oct 18 07:33:38 user nova-compute[74587]:     <acpi/>
Oct 18 07:33:38 user nova-compute[74587]:     <apic/>
Oct 18 07:33:38 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:33:38 user nova-compute[74587]:   </features>
Oct 18 07:33:38 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:33:38 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:33:38 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:33:38 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:33:38 user nova-compute[74587]:   </clock>
Oct 18 07:33:38 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:33:38 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:33:38 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:33:38 user nova-compute[74587]:   </cpu>
Oct 18 07:33:38 user nova-compute[74587]:   <devices>
Oct 18 07:33:38 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:33:38 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:33:38 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk"/>
Oct 18 07:33:38 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:33:38 user nova-compute[74587]:     </disk>
Oct 18 07:33:38 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:33:38 user nova-compute[74587]:       <mac address="fa:16:3e:9e:f9:46"/>
Oct 18 07:33:38 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:33:38 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:33:38 user nova-compute[74587]:       <target dev="tap9cff095f-77"/>
Oct 18 07:33:38 user nova-compute[74587]:     </interface>
Oct 18 07:33:38 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:33:38 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/console.log" append="off"/>
Oct 18 07:33:38 user nova-compute[74587]:     </serial>
Oct 18 07:33:38 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:33:38 user nova-compute[74587]:     <video>
Oct 18 07:33:38 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:33:38 user nova-compute[74587]:     </video>
Oct 18 07:33:38 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:33:38 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:33:38 user nova-compute[74587]:     </rng>
Oct 18 07:33:38 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:33:38 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:33:38 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:33:38 user nova-compute[74587]:     </memballoon>
Oct 18 07:33:38 user nova-compute[74587]:   </devices>
Oct 18 07:33:38 user nova-compute[74587]: </domain>
Oct 18 07:33:38 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1428891446',display_name='tempest-TestStampPattern-server-1428891446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1428891446',id=42,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCxWuTJ10c+whHcAUpDfDNeTRwFlH5W1d/E8jb2I/XpDzX51kKsRG9V2bdqFirsQKd0oQnenCerfZEhS8i1Eb78bX6HxHRaCTcnTxEjfRe5Q0diM4h1ECItqYcDOFplGQ==',key_name='tempest-TestStampPattern-794720162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='714315c24629492e94635d69c58bfef0',ramdisk_id='',reservation_id='r-8t7o0ocb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-145299941',owner_user_name='tempest-TestStampPattern-145299941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:33:35Z,user_data=None,user_id='8520ff9b3a8141ada3e3d5634762fa1b',uuid=ea414a0e-7538-4490-8b78-76b852ea4214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converting VIF {"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f9:46,bridge_name='br-int',has_traffic_filtering=True,id=9cff095f-7779-4f55-994c-1d42901b058f,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cff095f-77') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG os_vif [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f9:46,bridge_name='br-int',has_traffic_filtering=True,id=9cff095f-7779-4f55-994c-1d42901b058f,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cff095f-77') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2266c287-40a3-5f26-abf3-862c1cb24b5e', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cff095f-77, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cff095f-77, col_values=(('qos', UUID('35fc927e-4803-4815-a705-ed626e334166')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cff095f-77, col_values=(('external_ids', {'iface-id': '9cff095f-7779-4f55-994c-1d42901b058f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:f9:46', 'vm-uuid': 'ea414a0e-7538-4490-8b78-76b852ea4214'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.policy [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '427c1bee6dd74c388e98bfd44ecf7061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd18e7251dc4276a18772e1cd48276f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:38 user nova-compute[74587]: INFO os_vif [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f9:46,bridge_name='br-int',has_traffic_filtering=True,id=9cff095f-7779-4f55-994c-1d42901b058f,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cff095f-77')
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] No VIF found with MAC fa:16:3e:9e:f9:46, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:33:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Creating image(s)
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "/opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "/opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "/opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.216s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.network.neutron [req-83e9da62-1eda-4bdb-b888-51bd769c4101 req-3aca8c10-57a5-4ce4-9fcf-46d2f9be6e3d service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updated VIF entry in instance network info cache for port 9cff095f-7779-4f55-994c-1d42901b058f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.network.neutron [req-83e9da62-1eda-4bdb-b888-51bd769c4101 req-3aca8c10-57a5-4ce4-9fcf-46d2f9be6e3d service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updating instance_info_cache with network_info: [{"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-83e9da62-1eda-4bdb-b888-51bd769c4101 req-3aca8c10-57a5-4ce4-9fcf-46d2f9be6e3d service nova] Releasing lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '23665383537616230', 'path': '/dev/sdd'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665383537616230', 'path': '/dev/sdd'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-597322559',display_name='tempest-TestVolumeBootPattern-server-597322559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-597322559',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrD4QGeTTaMlXZ8vfsMMfK6pzduYaYdY6TtuahCvtTSdq2mzozIo9GLQClLeKc4Krkj+ygZI/TyGPqsgnJukfJMz2PgqlnAY3XlyONEXn8OLnPP3EVD58CNxJh6K+Kl2g==',key_name='tempest-TestVolumeBootPattern-1340892382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-cd42cq88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:33:18Z,user_data=None,user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=effe554a-aceb-459e-a45c-6b0a203f8553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:49,bridge_name='br-int',has_traffic_filtering=True,id=f187e480-b199-46b5-9915-8964a37ba626,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf187e480-b1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.objects.instance [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lazy-loading 'pci_devices' on Instance uuid effe554a-aceb-459e-a45c-6b0a203f8553 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.205s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.network.neutron [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Successfully created port: 788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:33:39 user nova-compute[74587]:   <uuid>effe554a-aceb-459e-a45c-6b0a203f8553</uuid>
Oct 18 07:33:39 user nova-compute[74587]:   <name>instance-00000028</name>
Oct 18 07:33:39 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:33:39 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:33:39 user nova-compute[74587]:   <metadata>
Oct 18 07:33:39 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:33:39 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:33:39 user nova-compute[74587]:       <nova:name>tempest-TestVolumeBootPattern-server-597322559</nova:name>
Oct 18 07:33:39 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:33:37</nova:creationTime>
Oct 18 07:33:39 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:33:39 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:33:39 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:33:39 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:33:39 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:33:39 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:33:39 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:33:39 user nova-compute[74587]:       <nova:owner>
Oct 18 07:33:39 user nova-compute[74587]:         <nova:user uuid="d13de789e98e4ba9ad22d665ff8e4ddd">tempest-TestVolumeBootPattern-1301266373-project-member</nova:user>
Oct 18 07:33:39 user nova-compute[74587]:         <nova:project uuid="f1cfa00773ba4c5498c56b84ccb307a9">tempest-TestVolumeBootPattern-1301266373</nova:project>
Oct 18 07:33:39 user nova-compute[74587]:       </nova:owner>
Oct 18 07:33:39 user nova-compute[74587]:       <nova:ports>
Oct 18 07:33:39 user nova-compute[74587]:         <nova:port uuid="f187e480-b199-46b5-9915-8964a37ba626">
Oct 18 07:33:39 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:33:39 user nova-compute[74587]:         </nova:port>
Oct 18 07:33:39 user nova-compute[74587]:       </nova:ports>
Oct 18 07:33:39 user nova-compute[74587]:     </nova:instance>
Oct 18 07:33:39 user nova-compute[74587]:   </metadata>
Oct 18 07:33:39 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:33:39 user nova-compute[74587]:     <system>
Oct 18 07:33:39 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:33:39 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:33:39 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:33:39 user nova-compute[74587]:       <entry name="serial">effe554a-aceb-459e-a45c-6b0a203f8553</entry>
Oct 18 07:33:39 user nova-compute[74587]:       <entry name="uuid">effe554a-aceb-459e-a45c-6b0a203f8553</entry>
Oct 18 07:33:39 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:33:39 user nova-compute[74587]:     </system>
Oct 18 07:33:39 user nova-compute[74587]:   </sysinfo>
Oct 18 07:33:39 user nova-compute[74587]:   <os>
Oct 18 07:33:39 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:33:39 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:33:39 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:33:39 user nova-compute[74587]:   </os>
Oct 18 07:33:39 user nova-compute[74587]:   <features>
Oct 18 07:33:39 user nova-compute[74587]:     <acpi/>
Oct 18 07:33:39 user nova-compute[74587]:     <apic/>
Oct 18 07:33:39 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:33:39 user nova-compute[74587]:   </features>
Oct 18 07:33:39 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:33:39 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:33:39 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:33:39 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:33:39 user nova-compute[74587]:   </clock>
Oct 18 07:33:39 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:33:39 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:33:39 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:33:39 user nova-compute[74587]:   </cpu>
Oct 18 07:33:39 user nova-compute[74587]:   <devices>
Oct 18 07:33:39 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:33:39 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:33:39 user nova-compute[74587]:       <source dev="/dev/sdd"/>
Oct 18 07:33:39 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:33:39 user nova-compute[74587]:       <serial>98dd3b2e-6ddf-42f2-9e39-a36e9236da62</serial>
Oct 18 07:33:39 user nova-compute[74587]:     </disk>
Oct 18 07:33:39 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:33:39 user nova-compute[74587]:       <mac address="fa:16:3e:9f:6e:49"/>
Oct 18 07:33:39 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:33:39 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:33:39 user nova-compute[74587]:       <target dev="tapf187e480-b1"/>
Oct 18 07:33:39 user nova-compute[74587]:     </interface>
Oct 18 07:33:39 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:33:39 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/effe554a-aceb-459e-a45c-6b0a203f8553/console.log" append="off"/>
Oct 18 07:33:39 user nova-compute[74587]:     </serial>
Oct 18 07:33:39 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:33:39 user nova-compute[74587]:     <video>
Oct 18 07:33:39 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:33:39 user nova-compute[74587]:     </video>
Oct 18 07:33:39 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:33:39 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:33:39 user nova-compute[74587]:     </rng>
Oct 18 07:33:39 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:33:39 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:33:39 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:33:39 user nova-compute[74587]:     </memballoon>
Oct 18 07:33:39 user nova-compute[74587]:   </devices>
Oct 18 07:33:39 user nova-compute[74587]: </domain>
Oct 18 07:33:39 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-597322559',display_name='tempest-TestVolumeBootPattern-server-597322559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-597322559',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrD4QGeTTaMlXZ8vfsMMfK6pzduYaYdY6TtuahCvtTSdq2mzozIo9GLQClLeKc4Krkj+ygZI/TyGPqsgnJukfJMz2PgqlnAY3XlyONEXn8OLnPP3EVD58CNxJh6K+Kl2g==',key_name='tempest-TestVolumeBootPattern-1340892382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-cd42cq88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:33:18Z,user_data=None,user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=effe554a-aceb-459e-a45c-6b0a203f8553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:49,bridge_name='br-int',has_traffic_filtering=True,id=f187e480-b199-46b5-9915-8964a37ba626,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf187e480-b1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG os_vif [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:49,bridge_name='br-int',has_traffic_filtering=True,id=f187e480-b199-46b5-9915-8964a37ba626,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf187e480-b1') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8213a600-911e-5efc-97e7-ae849cbeaa86', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk 1073741824" returned: 0 in 0.068s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf187e480-b1, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf187e480-b1, col_values=(('qos', UUID('24e846ef-3f68-4b82-91e6-ac8bd870cea8')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf187e480-b1, col_values=(('external_ids', {'iface-id': 'f187e480-b199-46b5-9915-8964a37ba626', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:6e:49', 'vm-uuid': 'effe554a-aceb-459e-a45c-6b0a203f8553'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:39 user nova-compute[74587]: INFO os_vif [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:49,bridge_name='br-int',has_traffic_filtering=True,id=f187e480-b199-46b5-9915-8964a37ba626,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf187e480-b1')
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] No VIF found with MAC fa:16:3e:9f:6e:49, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.192s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Cannot resize image /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Ensure instance console log exists: /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-b3df9d20-163a-471a-b519-81f5459b7908 req-8047865a-2049-4f95-b0bb-7f3e8f13a16a service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b3df9d20-163a-471a-b519-81f5459b7908 req-8047865a-2049-4f95-b0bb-7f3e8f13a16a service nova] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b3df9d20-163a-471a-b519-81f5459b7908 req-8047865a-2049-4f95-b0bb-7f3e8f13a16a service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b3df9d20-163a-471a-b519-81f5459b7908 req-8047865a-2049-4f95-b0bb-7f3e8f13a16a service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.compute.manager [req-b3df9d20-163a-471a-b519-81f5459b7908 req-8047865a-2049-4f95-b0bb-7f3e8f13a16a service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] No waiting events found dispatching network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:40 user nova-compute[74587]: WARNING nova.compute.manager [req-b3df9d20-163a-471a-b519-81f5459b7908 req-8047865a-2049-4f95-b0bb-7f3e8f13a16a service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received unexpected event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Successfully updated port: 788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "refresh_cache-071cfc59-d9ec-4641-a3da-6e32454a4f37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquired lock "refresh_cache-071cfc59-d9ec-4641-a3da-6e32454a4f37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.network.neutron [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Updating instance_info_cache with network_info: [{"id": "788228f5-6240-41f4-9d7b-e9757d227a66", "address": "fa:16:3e:1f:3e:a3", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788228f5-62", "ovs_interfaceid": "788228f5-6240-41f4-9d7b-e9757d227a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Releasing lock "refresh_cache-071cfc59-d9ec-4641-a3da-6e32454a4f37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Instance network_info: |[{"id": "788228f5-6240-41f4-9d7b-e9757d227a66", "address": "fa:16:3e:1f:3e:a3", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788228f5-62", "ovs_interfaceid": "788228f5-6240-41f4-9d7b-e9757d227a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Start _get_guest_xml network_info=[{"id": "788228f5-6240-41f4-9d7b-e9757d227a66", "address": "fa:16:3e:1f:3e:a3", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788228f5-62", "ovs_interfaceid": "788228f5-6240-41f4-9d7b-e9757d227a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:33:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-780846111',display_name='tempest-VolumesActionsTest-instance-780846111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-780846111',id=43,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbd18e7251dc4276a18772e1cd48276f',ramdisk_id='',reservation_id='r-y0asnl6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-496843029',owner_user_name='tempest-VolumesActionsTest-496843029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:33:39Z,user_data=None,user_id='427c1bee6dd74c388e98bfd44ecf7061',uuid=071cfc59-d9ec-4641-a3da-6e32454a4f37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "788228f5-6240-41f4-9d7b-e9757d227a66", "address": "fa:16:3e:1f:3e:a3", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788228f5-62", "ovs_interfaceid": "788228f5-6240-41f4-9d7b-e9757d227a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converting VIF {"id": "788228f5-6240-41f4-9d7b-e9757d227a66", "address": "fa:16:3e:1f:3e:a3", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788228f5-62", "ovs_interfaceid": "788228f5-6240-41f4-9d7b-e9757d227a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:a3,bridge_name='br-int',has_traffic_filtering=True,id=788228f5-6240-41f4-9d7b-e9757d227a66,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788228f5-62') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lazy-loading 'pci_devices' on Instance uuid 071cfc59-d9ec-4641-a3da-6e32454a4f37 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:33:40 user nova-compute[74587]:   <uuid>071cfc59-d9ec-4641-a3da-6e32454a4f37</uuid>
Oct 18 07:33:40 user nova-compute[74587]:   <name>instance-0000002b</name>
Oct 18 07:33:40 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:33:40 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:33:40 user nova-compute[74587]:   <metadata>
Oct 18 07:33:40 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:33:40 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:33:40 user nova-compute[74587]:       <nova:name>tempest-VolumesActionsTest-instance-780846111</nova:name>
Oct 18 07:33:40 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:33:40</nova:creationTime>
Oct 18 07:33:40 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:33:40 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:33:40 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:33:40 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:33:40 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:33:40 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:33:40 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:33:40 user nova-compute[74587]:       <nova:owner>
Oct 18 07:33:40 user nova-compute[74587]:         <nova:user uuid="427c1bee6dd74c388e98bfd44ecf7061">tempest-VolumesActionsTest-496843029-project-member</nova:user>
Oct 18 07:33:40 user nova-compute[74587]:         <nova:project uuid="fbd18e7251dc4276a18772e1cd48276f">tempest-VolumesActionsTest-496843029</nova:project>
Oct 18 07:33:40 user nova-compute[74587]:       </nova:owner>
Oct 18 07:33:40 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:33:40 user nova-compute[74587]:       <nova:ports>
Oct 18 07:33:40 user nova-compute[74587]:         <nova:port uuid="788228f5-6240-41f4-9d7b-e9757d227a66">
Oct 18 07:33:40 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 07:33:40 user nova-compute[74587]:         </nova:port>
Oct 18 07:33:40 user nova-compute[74587]:       </nova:ports>
Oct 18 07:33:40 user nova-compute[74587]:     </nova:instance>
Oct 18 07:33:40 user nova-compute[74587]:   </metadata>
Oct 18 07:33:40 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:33:40 user nova-compute[74587]:     <system>
Oct 18 07:33:40 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:33:40 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:33:40 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:33:40 user nova-compute[74587]:       <entry name="serial">071cfc59-d9ec-4641-a3da-6e32454a4f37</entry>
Oct 18 07:33:40 user nova-compute[74587]:       <entry name="uuid">071cfc59-d9ec-4641-a3da-6e32454a4f37</entry>
Oct 18 07:33:40 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:33:40 user nova-compute[74587]:     </system>
Oct 18 07:33:40 user nova-compute[74587]:   </sysinfo>
Oct 18 07:33:40 user nova-compute[74587]:   <os>
Oct 18 07:33:40 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:33:40 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:33:40 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:33:40 user nova-compute[74587]:   </os>
Oct 18 07:33:40 user nova-compute[74587]:   <features>
Oct 18 07:33:40 user nova-compute[74587]:     <acpi/>
Oct 18 07:33:40 user nova-compute[74587]:     <apic/>
Oct 18 07:33:40 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:33:40 user nova-compute[74587]:   </features>
Oct 18 07:33:40 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:33:40 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:33:40 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:33:40 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:33:40 user nova-compute[74587]:   </clock>
Oct 18 07:33:40 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:33:40 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:33:40 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:33:40 user nova-compute[74587]:   </cpu>
Oct 18 07:33:40 user nova-compute[74587]:   <devices>
Oct 18 07:33:40 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:33:40 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:33:40 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk"/>
Oct 18 07:33:40 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:33:40 user nova-compute[74587]:     </disk>
Oct 18 07:33:40 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:33:40 user nova-compute[74587]:       <mac address="fa:16:3e:1f:3e:a3"/>
Oct 18 07:33:40 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:33:40 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:33:40 user nova-compute[74587]:       <target dev="tap788228f5-62"/>
Oct 18 07:33:40 user nova-compute[74587]:     </interface>
Oct 18 07:33:40 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:33:40 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/console.log" append="off"/>
Oct 18 07:33:40 user nova-compute[74587]:     </serial>
Oct 18 07:33:40 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:33:40 user nova-compute[74587]:     <video>
Oct 18 07:33:40 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:33:40 user nova-compute[74587]:     </video>
Oct 18 07:33:40 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:33:40 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:33:40 user nova-compute[74587]:     </rng>
Oct 18 07:33:40 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:33:40 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:33:40 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:33:40 user nova-compute[74587]:     </memballoon>
Oct 18 07:33:40 user nova-compute[74587]:   </devices>
Oct 18 07:33:40 user nova-compute[74587]: </domain>
Oct 18 07:33:40 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-780846111',display_name='tempest-VolumesActionsTest-instance-780846111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-780846111',id=43,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbd18e7251dc4276a18772e1cd48276f',ramdisk_id='',reservation_id='r-y0asnl6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-496843029',owner_user_name='tempest-VolumesActionsTest-496843029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:33:39Z,user_data=None,user_id='427c1bee6dd74c388e98bfd44ecf7061',uuid=071cfc59-d9ec-4641-a3da-6e32454a4f37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "788228f5-6240-41f4-9d7b-e9757d227a66", "address": "fa:16:3e:1f:3e:a3", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788228f5-62", "ovs_interfaceid": "788228f5-6240-41f4-9d7b-e9757d227a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converting VIF {"id": "788228f5-6240-41f4-9d7b-e9757d227a66", "address": "fa:16:3e:1f:3e:a3", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788228f5-62", "ovs_interfaceid": "788228f5-6240-41f4-9d7b-e9757d227a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:a3,bridge_name='br-int',has_traffic_filtering=True,id=788228f5-6240-41f4-9d7b-e9757d227a66,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788228f5-62') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG os_vif [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:a3,bridge_name='br-int',has_traffic_filtering=True,id=788228f5-6240-41f4-9d7b-e9757d227a66,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788228f5-62') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48ad200c-e802-5fd1-9286-67d193cd97e2', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap788228f5-62, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap788228f5-62, col_values=(('qos', UUID('27251146-345d-44ce-b880-5ae390741f77')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap788228f5-62, col_values=(('external_ids', {'iface-id': '788228f5-6240-41f4-9d7b-e9757d227a66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:3e:a3', 'vm-uuid': '071cfc59-d9ec-4641-a3da-6e32454a4f37'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:40 user nova-compute[74587]: INFO os_vif [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:a3,bridge_name='br-int',has_traffic_filtering=True,id=788228f5-6240-41f4-9d7b-e9757d227a66,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788228f5-62')
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:33:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] No VIF found with MAC fa:16:3e:1f:3e:a3, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:33:41 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Received event network-changed-788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Refreshing instance network info cache due to event network-changed-788228f5-6240-41f4-9d7b-e9757d227a66. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] Acquiring lock "refresh_cache-071cfc59-d9ec-4641-a3da-6e32454a4f37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] Acquired lock "refresh_cache-071cfc59-d9ec-4641-a3da-6e32454a4f37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Refreshing network info cache for port 788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Updated VIF entry in instance network info cache for port 788228f5-6240-41f4-9d7b-e9757d227a66. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Updating instance_info_cache with network_info: [{"id": "788228f5-6240-41f4-9d7b-e9757d227a66", "address": "fa:16:3e:1f:3e:a3", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788228f5-62", "ovs_interfaceid": "788228f5-6240-41f4-9d7b-e9757d227a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] Releasing lock "refresh_cache-071cfc59-d9ec-4641-a3da-6e32454a4f37" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG nova.compute.manager [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] No waiting events found dispatching network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:42 user nova-compute[74587]: WARNING nova.compute.manager [req-3eeb30c6-2a81-4bb0-ab2c-715a1e1bf9fe req-5a68afaf-62ae-4d96-b86d-0226167d30f8 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received unexpected event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 07:33:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-8e871be6-d277-4ffc-8b5b-8fcfd20e4dba req-ccaab548-eefa-4763-9aa1-09750168fa10 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received event network-vif-plugged-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8e871be6-d277-4ffc-8b5b-8fcfd20e4dba req-ccaab548-eefa-4763-9aa1-09750168fa10 service nova] Acquiring lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8e871be6-d277-4ffc-8b5b-8fcfd20e4dba req-ccaab548-eefa-4763-9aa1-09750168fa10 service nova] Lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8e871be6-d277-4ffc-8b5b-8fcfd20e4dba req-ccaab548-eefa-4763-9aa1-09750168fa10 service nova] Lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG nova.compute.manager [req-8e871be6-d277-4ffc-8b5b-8fcfd20e4dba req-ccaab548-eefa-4763-9aa1-09750168fa10 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] No waiting events found dispatching network-vif-plugged-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:43 user nova-compute[74587]: WARNING nova.compute.manager [req-8e871be6-d277-4ffc-8b5b-8fcfd20e4dba req-ccaab548-eefa-4763-9aa1-09750168fa10 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received unexpected event network-vif-plugged-f187e480-b199-46b5-9915-8964a37ba626 for instance with vm_state building and task_state spawning.
Oct 18 07:33:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received event network-vif-plugged-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] Lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] Lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] No waiting events found dispatching network-vif-plugged-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:44 user nova-compute[74587]: WARNING nova.compute.manager [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received unexpected event network-vif-plugged-9cff095f-7779-4f55-994c-1d42901b058f for instance with vm_state building and task_state spawning.
Oct 18 07:33:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received event network-vif-plugged-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] Lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] Lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] No waiting events found dispatching network-vif-plugged-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:44 user nova-compute[74587]: WARNING nova.compute.manager [req-5edde543-5012-4522-9961-32790640d0e4 req-7195de33-af15-4d23-beae-158c4f1bed2b service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received unexpected event network-vif-plugged-9cff095f-7779-4f55-994c-1d42901b058f for instance with vm_state building and task_state spawning.
Oct 18 07:33:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received event network-vif-plugged-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] Acquiring lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] Lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] Lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] No waiting events found dispatching network-vif-plugged-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:45 user nova-compute[74587]: WARNING nova.compute.manager [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received unexpected event network-vif-plugged-f187e480-b199-46b5-9915-8964a37ba626 for instance with vm_state building and task_state spawning.
Oct 18 07:33:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Received event network-vif-plugged-788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] Acquiring lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] No waiting events found dispatching network-vif-plugged-788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:45 user nova-compute[74587]: WARNING nova.compute.manager [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Received unexpected event network-vif-plugged-788228f5-6240-41f4-9d7b-e9757d227a66 for instance with vm_state building and task_state spawning.
Oct 18 07:33:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Received event network-vif-plugged-788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] Acquiring lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] No waiting events found dispatching network-vif-plugged-788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:45 user nova-compute[74587]: WARNING nova.compute.manager [req-2790efcc-d3cd-4c73-baa3-e21b8ed86e4b req-28ff35eb-cebc-4030-b94f-740b30ceea73 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Received unexpected event network-vif-plugged-788228f5-6240-41f4-9d7b-e9757d227a66 for instance with vm_state building and task_state spawning.
Oct 18 07:33:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:33:45 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance spawned successfully.
Oct 18 07:33:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:33:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-51385fbd-8ff4-4340-ae0e-5edf9c4b6537 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "7df5792a-005a-49b9-856f-7758869917fd" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 31.163s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:33:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Instance spawned successfully.
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: INFO nova.compute.manager [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Took 11.02 seconds to spawn the instance on the hypervisor.
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:33:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Instance spawned successfully.
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: INFO nova.compute.manager [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Took 12.53 seconds to build instance.
Oct 18 07:33:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-824f6d75-950b-42ae-a81d-85830f65b765 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.712s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:46 user nova-compute[74587]: INFO nova.compute.manager [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Took 9.00 seconds to spawn the instance on the hypervisor.
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:33:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Instance spawned successfully.
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:33:46 user nova-compute[74587]: INFO nova.compute.manager [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Took 29.81 seconds to build instance.
Oct 18 07:33:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-807be676-2582-4465-a4b6-2f2aa4c51d9c tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "effe554a-aceb-459e-a45c-6b0a203f8553" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.035s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:47 user nova-compute[74587]: INFO nova.compute.manager [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Took 8.23 seconds to spawn the instance on the hypervisor.
Oct 18 07:33:47 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:33:47 user nova-compute[74587]: INFO nova.compute.manager [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Took 9.68 seconds to build instance.
Oct 18 07:33:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3f9e08f3-574f-4a1f-af6b-32c2d82e5ec7 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.799s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-ffbc81ed-9769-4196-a1cd-534e266d5db6 req-6ecca3f1-b606-40d0-920e-b3ec853c9eba service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received event network-changed-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-ffbc81ed-9769-4196-a1cd-534e266d5db6 req-6ecca3f1-b606-40d0-920e-b3ec853c9eba service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Refreshing instance network info cache due to event network-changed-ba393f25-09d5-4778-9e2b-daba0edc41d6. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ffbc81ed-9769-4196-a1cd-534e266d5db6 req-6ecca3f1-b606-40d0-920e-b3ec853c9eba service nova] Acquiring lock "refresh_cache-03838929-5ebc-4590-98e4-0b8dfa6d4570" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ffbc81ed-9769-4196-a1cd-534e266d5db6 req-6ecca3f1-b606-40d0-920e-b3ec853c9eba service nova] Acquired lock "refresh_cache-03838929-5ebc-4590-98e4-0b8dfa6d4570" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG nova.network.neutron [req-ffbc81ed-9769-4196-a1cd-534e266d5db6 req-6ecca3f1-b606-40d0-920e-b3ec853c9eba service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Refreshing network info cache for port ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lazy-loading 'flavor' on Instance uuid 03838929-5ebc-4590-98e4-0b8dfa6d4570 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:33:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Ignoring supplied device name: /dev/vdb
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:51 user nova-compute[74587]: INFO nova.compute.manager [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Attaching volume 579b82b2-031c-4428-a6c9-19a01263d285 to /dev/vdb
Oct 18 07:33:51 user nova-compute[74587]: DEBUG nova.network.neutron [req-ffbc81ed-9769-4196-a1cd-534e266d5db6 req-6ecca3f1-b606-40d0-920e-b3ec853c9eba service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Updated VIF entry in instance network info cache for port ba393f25-09d5-4778-9e2b-daba0edc41d6. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG nova.network.neutron [req-ffbc81ed-9769-4196-a1cd-534e266d5db6 req-6ecca3f1-b606-40d0-920e-b3ec853c9eba service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Updating instance_info_cache with network_info: [{"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG os_brick.utils [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ffbc81ed-9769-4196-a1cd-534e266d5db6 req-6ecca3f1-b606-40d0-920e-b3ec853c9eba service nova] Releasing lock "refresh_cache-03838929-5ebc-4590-98e4-0b8dfa6d4570" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[100a071c-6f80-4a19-9e23-d0c45f3e10c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[577c3bfc-7b6f-48f3-864e-8bdcfe14b782]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f492db8-21e9-49e1-93ab-df8f719dd3bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4afc71-2221-4900-9d1d-08ef1089a4d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:33:52 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:33:52 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[722bc10d-5a96-47dc-a135-a46d6e1aafb6]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG os_brick.utils [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:33:52 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Updating existing volume attachment record: 38e1ec36-4497-4628-b8f0-8a82eabf8012 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:33:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "773850ee-146d-4e76-9096-8dc18e03221f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "773850ee-146d-4e76-9096-8dc18e03221f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "773850ee-146d-4e76-9096-8dc18e03221f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "773850ee-146d-4e76-9096-8dc18e03221f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "773850ee-146d-4e76-9096-8dc18e03221f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:57 user nova-compute[74587]: INFO nova.compute.manager [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Terminating instance
Oct 18 07:33:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG nova.compute.manager [req-96c09622-8480-4b2b-a1cf-ac263f1ea0bb req-482c19fe-23b6-4fb9-bf0b-ac3cd7368b98 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received event network-vif-unplugged-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-96c09622-8480-4b2b-a1cf-ac263f1ea0bb req-482c19fe-23b6-4fb9-bf0b-ac3cd7368b98 service nova] Acquiring lock "773850ee-146d-4e76-9096-8dc18e03221f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-96c09622-8480-4b2b-a1cf-ac263f1ea0bb req-482c19fe-23b6-4fb9-bf0b-ac3cd7368b98 service nova] Lock "773850ee-146d-4e76-9096-8dc18e03221f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-96c09622-8480-4b2b-a1cf-ac263f1ea0bb req-482c19fe-23b6-4fb9-bf0b-ac3cd7368b98 service nova] Lock "773850ee-146d-4e76-9096-8dc18e03221f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG nova.compute.manager [req-96c09622-8480-4b2b-a1cf-ac263f1ea0bb req-482c19fe-23b6-4fb9-bf0b-ac3cd7368b98 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] No waiting events found dispatching network-vif-unplugged-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:57 user nova-compute[74587]: DEBUG nova.compute.manager [req-96c09622-8480-4b2b-a1cf-ac263f1ea0bb req-482c19fe-23b6-4fb9-bf0b-ac3cd7368b98 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received event network-vif-unplugged-ae95937e-2772-434a-8a14-8f361e17775a for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:58 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Instance destroyed successfully.
Oct 18 07:33:58 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lazy-loading 'resources' on Instance uuid 773850ee-146d-4e76-9096-8dc18e03221f {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1605029498',display_name='tempest-ServerActionsTestOtherA-server-1605029498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1605029498',id=16,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA52QLTWvy/v2jV8SnvcFET/QtPPTqG94sHIUJ+eIA4fj3Aw4bOkxeUXjNyfaIA0FLk6wcOPrhSmuqIwPWgig8KHxvH3mp04gQBlQsoVn3vpHBaDRDx2a25MshLKHMkpQ==',key_name='tempest-keypair-952803272',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:14:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='196ea516329b4e479bd8f54644007c57',ramdisk_id='',reservation_id='r-syd5j30s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2039083727',owner_user_name='tempest-ServerActionsTestOtherA-2039083727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1730cd79c54e748232c046b4d3e412',uuid=773850ee-146d-4e76-9096-8dc18e03221f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converting VIF {"id": "ae95937e-2772-434a-8a14-8f361e17775a", "address": "fa:16:3e:ae:bc:7f", "network": {"id": "bd8e4cec-48c8-418a-95aa-dee37f965edc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-655313875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "196ea516329b4e479bd8f54644007c57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae95937e-27", "ovs_interfaceid": "ae95937e-2772-434a-8a14-8f361e17775a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:bc:7f,bridge_name='br-int',has_traffic_filtering=True,id=ae95937e-2772-434a-8a14-8f361e17775a,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae95937e-27') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG os_vif [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:bc:7f,bridge_name='br-int',has_traffic_filtering=True,id=ae95937e-2772-434a-8a14-8f361e17775a,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae95937e-27') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae95937e-27, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3e94869-8e97-4d69-bf61-1eecc4e18dcc) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:33:58 user nova-compute[74587]: INFO os_vif [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:bc:7f,bridge_name='br-int',has_traffic_filtering=True,id=ae95937e-2772-434a-8a14-8f361e17775a,network=Network(bd8e4cec-48c8-418a-95aa-dee37f965edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae95937e-27')
Oct 18 07:33:58 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Deleting instance files /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f_del
Oct 18 07:33:58 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Deletion of /opt/stack/data/nova/instances/773850ee-146d-4e76-9096-8dc18e03221f_del complete
Oct 18 07:33:58 user nova-compute[74587]: INFO nova.compute.manager [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 18 07:33:58 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:33:58 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:33:59 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:33:59 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Took 0.75 seconds to deallocate network for instance.
Oct 18 07:33:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:59 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:33:59 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:33:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:59 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Deleted allocations for instance 773850ee-146d-4e76-9096-8dc18e03221f
Oct 18 07:33:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3e57f1b2-7769-4785-9011-ce98cecda7ac tempest-ServerActionsTestOtherA-2039083727 tempest-ServerActionsTestOtherA-2039083727-project-member] Lock "773850ee-146d-4e76-9096-8dc18e03221f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.433s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-086bd743-fbe3-462f-837b-198cc25d0c50 req-7d3d8a67-b63c-45cc-aa95-8d5dad46b527 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received event network-vif-plugged-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:33:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-086bd743-fbe3-462f-837b-198cc25d0c50 req-7d3d8a67-b63c-45cc-aa95-8d5dad46b527 service nova] Acquiring lock "773850ee-146d-4e76-9096-8dc18e03221f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:33:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-086bd743-fbe3-462f-837b-198cc25d0c50 req-7d3d8a67-b63c-45cc-aa95-8d5dad46b527 service nova] Lock "773850ee-146d-4e76-9096-8dc18e03221f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:33:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-086bd743-fbe3-462f-837b-198cc25d0c50 req-7d3d8a67-b63c-45cc-aa95-8d5dad46b527 service nova] Lock "773850ee-146d-4e76-9096-8dc18e03221f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:33:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-086bd743-fbe3-462f-837b-198cc25d0c50 req-7d3d8a67-b63c-45cc-aa95-8d5dad46b527 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] No waiting events found dispatching network-vif-plugged-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:33:59 user nova-compute[74587]: WARNING nova.compute.manager [req-086bd743-fbe3-462f-837b-198cc25d0c50 req-7d3d8a67-b63c-45cc-aa95-8d5dad46b527 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received unexpected event network-vif-plugged-ae95937e-2772-434a-8a14-8f361e17775a for instance with vm_state deleted and task_state None.
Oct 18 07:33:59 user nova-compute[74587]: DEBUG nova.compute.manager [req-086bd743-fbe3-462f-837b-198cc25d0c50 req-7d3d8a67-b63c-45cc-aa95-8d5dad46b527 service nova] [instance: 773850ee-146d-4e76-9096-8dc18e03221f] Received event network-vif-deleted-ae95937e-2772-434a-8a14-8f361e17775a {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 7df5792a-005a-49b9-856f-7758869917fd {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 79f2ca30-3797-41a4-bbb2-3431bedbf8f9 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 03838929-5ebc-4590-98e4-0b8dfa6d4570 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid effe554a-aceb-459e-a45c-6b0a203f8553 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid ea414a0e-7538-4490-8b78-76b852ea4214 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 071cfc59-d9ec-4641-a3da-6e32454a4f37 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "7df5792a-005a-49b9-856f-7758869917fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "effe554a-aceb-459e-a45c-6b0a203f8553" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "effe554a-aceb-459e-a45c-6b0a203f8553" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "071cfc59-d9ec-4641-a3da-6e32454a4f37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "7df5792a-005a-49b9-856f-7758869917fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "effe554a-aceb-459e-a45c-6b0a203f8553" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:34:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyDuoHag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:34:10 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:34:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:34:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:34:10 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:34:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:34:10 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:34:11 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[234321b8-0bea-46fc-9126-05ffc89878f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:34:11 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ecd6a1-034e-431c-99cd-0775265a6a0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285] added
Oct 18 07:34:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20864e4-00ec-40fe-bd78-889ec360b6d0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f066af0d-107b-4d60-862d-085a90460823]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyDuoHag {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyDuoHag" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8349d1-1c06-4192-a9eb-4b11bdd155bb]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GyDuoHag'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cddf44-1807-42fd-bd56-c789441b14e9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdb7736-3fc5-45d4-bf35-c06e3a3ed41e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[66776744-d67a-4f9f-b307-0322302a4eae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285, portal: 172.16.0.220,3260]
Oct 18 07:34:11 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285, portal: 172.16.0.220,3260] successful.
Oct 18 07:34:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.061s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[209a49f1-a541-4419-b989-722ed589d919]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a89044-07a2-41c3-8d4f-2e4e4dc185c7]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)
Oct 18 07:34:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eca9d3-c744-404d-ac4a-234332e8eafa]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:34:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyDuoHag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23830633865376336', 'path': '/dev/sde'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830633865376336', 'path': '/dev/sde'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lazy-loading 'flavor' on Instance uuid 03838929-5ebc-4590-98e4-0b8dfa6d4570 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:34:12 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:34:12 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:34:12 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:34:12 user nova-compute[74587]:   <serial>579b82b2-031c-4428-a6c9-19a01263d285</serial>
Oct 18 07:34:12 user nova-compute[74587]: </disk>
Oct 18 07:34:12 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:34:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] No VIF found with MAC fa:16:3e:e8:9c:0b, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:34:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c2f97a11-6269-41af-8d79-0a54c15b50fb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.292s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.444s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:23 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:34:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:34:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:24 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:34:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:34:28 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:34:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:34:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:29 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:34:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:34 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:34:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:34:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:34:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:34:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:34:34 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:34:34 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 7df5792a-005a-49b9-856f-7758869917fd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating instance_info_cache with network_info: [{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:34:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:37 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:34:37 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=7784MB free_disk=25.13302993774414GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 79f2ca30-3797-41a4-bbb2-3431bedbf8f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 03838929-5ebc-4590-98e4-0b8dfa6d4570 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 7df5792a-005a-49b9-856f-7758869917fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance effe554a-aceb-459e-a45c-6b0a203f8553 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ea414a0e-7538-4490-8b78-76b852ea4214 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 071cfc59-d9ec-4641-a3da-6e32454a4f37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:34:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:34:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:34:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:34:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Acquiring lock "c850cad2-d127-4a39-bf71-4ca764342164" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "c850cad2-d127-4a39-bf71-4ca764342164" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:55 user nova-compute[74587]: DEBUG nova.compute.manager [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:34:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:55 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:34:55 user nova-compute[74587]: INFO nova.compute.claims [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Claim successful on node user
Oct 18 07:34:55 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:34:55 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:34:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:55 user nova-compute[74587]: DEBUG nova.compute.manager [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG nova.compute.manager [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG nova.network.neutron [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:34:56 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:34:56 user nova-compute[74587]: DEBUG nova.compute.manager [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG nova.compute.manager [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:34:56 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Creating image(s)
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Acquiring lock "/opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "/opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "/opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG nova.policy [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e3cac1f54f34a7c9e5485136df872c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e661fa797e4575aa4f5acd581f302b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk 1073741824" returned: 0 in 0.059s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:34:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:34:57 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Cannot resize image /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:34:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:34:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Ensure instance console log exists: /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:34:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:34:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:34:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:34:57 user nova-compute[74587]: DEBUG nova.network.neutron [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Successfully created port: 6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Successfully updated port: 6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Acquiring lock "refresh_cache-c850cad2-d127-4a39-bf71-4ca764342164" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Acquired lock "refresh_cache-c850cad2-d127-4a39-bf71-4ca764342164" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-36c4a7f9-fca7-47a1-91e9-21f2e37dd1ff req-ac227ed6-794a-4457-ba49-c7e44e86dd35 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Received event network-changed-6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.compute.manager [req-36c4a7f9-fca7-47a1-91e9-21f2e37dd1ff req-ac227ed6-794a-4457-ba49-c7e44e86dd35 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Refreshing instance network info cache due to event network-changed-6d8b91c9-7557-4815-8db6-8f22a41b1e11. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-36c4a7f9-fca7-47a1-91e9-21f2e37dd1ff req-ac227ed6-794a-4457-ba49-c7e44e86dd35 service nova] Acquiring lock "refresh_cache-c850cad2-d127-4a39-bf71-4ca764342164" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.neutron [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Updating instance_info_cache with network_info: [{"id": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "address": "fa:16:3e:ea:ac:a8", "network": {"id": "182cffc6-c674-4641-b988-87d1b288c7ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "21b75bb9de7244cb832931a64959110d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8b91c9-75", "ovs_interfaceid": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Releasing lock "refresh_cache-c850cad2-d127-4a39-bf71-4ca764342164" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Instance network_info: |[{"id": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "address": "fa:16:3e:ea:ac:a8", "network": {"id": "182cffc6-c674-4641-b988-87d1b288c7ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "21b75bb9de7244cb832931a64959110d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8b91c9-75", "ovs_interfaceid": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-36c4a7f9-fca7-47a1-91e9-21f2e37dd1ff req-ac227ed6-794a-4457-ba49-c7e44e86dd35 service nova] Acquired lock "refresh_cache-c850cad2-d127-4a39-bf71-4ca764342164" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.neutron [req-36c4a7f9-fca7-47a1-91e9-21f2e37dd1ff req-ac227ed6-794a-4457-ba49-c7e44e86dd35 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Refreshing network info cache for port 6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Start _get_guest_xml network_info=[{"id": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "address": "fa:16:3e:ea:ac:a8", "network": {"id": "182cffc6-c674-4641-b988-87d1b288c7ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "21b75bb9de7244cb832931a64959110d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8b91c9-75", "ovs_interfaceid": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:34:58 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:34:58 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1286203425',display_name='tempest-VolumesNegativeTest-instance-1286203425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1286203425',id=44,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6e661fa797e4575aa4f5acd581f302b',ramdisk_id='',reservation_id='r-f857yp83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-475950850',owner_user_name='tempest-VolumesNegativeTest-475950850-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:34:56Z,user_data=None,user_id='7e3cac1f54f34a7c9e5485136df872c4',uuid=c850cad2-d127-4a39-bf71-4ca764342164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "address": "fa:16:3e:ea:ac:a8", "network": {"id": "182cffc6-c674-4641-b988-87d1b288c7ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "21b75bb9de7244cb832931a64959110d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8b91c9-75", "ovs_interfaceid": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Converting VIF {"id": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "address": "fa:16:3e:ea:ac:a8", "network": {"id": "182cffc6-c674-4641-b988-87d1b288c7ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "21b75bb9de7244cb832931a64959110d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8b91c9-75", "ovs_interfaceid": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ac:a8,bridge_name='br-int',has_traffic_filtering=True,id=6d8b91c9-7557-4815-8db6-8f22a41b1e11,network=Network(182cffc6-c674-4641-b988-87d1b288c7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8b91c9-75') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.objects.instance [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lazy-loading 'pci_devices' on Instance uuid c850cad2-d127-4a39-bf71-4ca764342164 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:34:58 user nova-compute[74587]:   <uuid>c850cad2-d127-4a39-bf71-4ca764342164</uuid>
Oct 18 07:34:58 user nova-compute[74587]:   <name>instance-0000002c</name>
Oct 18 07:34:58 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:34:58 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:34:58 user nova-compute[74587]:   <metadata>
Oct 18 07:34:58 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:34:58 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:34:58 user nova-compute[74587]:       <nova:name>tempest-VolumesNegativeTest-instance-1286203425</nova:name>
Oct 18 07:34:58 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:34:58</nova:creationTime>
Oct 18 07:34:58 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:34:58 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:34:58 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:34:58 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:34:58 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:34:58 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:34:58 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:34:58 user nova-compute[74587]:       <nova:owner>
Oct 18 07:34:58 user nova-compute[74587]:         <nova:user uuid="7e3cac1f54f34a7c9e5485136df872c4">tempest-VolumesNegativeTest-475950850-project-member</nova:user>
Oct 18 07:34:58 user nova-compute[74587]:         <nova:project uuid="c6e661fa797e4575aa4f5acd581f302b">tempest-VolumesNegativeTest-475950850</nova:project>
Oct 18 07:34:58 user nova-compute[74587]:       </nova:owner>
Oct 18 07:34:58 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:34:58 user nova-compute[74587]:       <nova:ports>
Oct 18 07:34:58 user nova-compute[74587]:         <nova:port uuid="6d8b91c9-7557-4815-8db6-8f22a41b1e11">
Oct 18 07:34:58 user nova-compute[74587]:           <nova:ip type="fixed" address="192.168.233.72" ipVersion="4"/>
Oct 18 07:34:58 user nova-compute[74587]:         </nova:port>
Oct 18 07:34:58 user nova-compute[74587]:       </nova:ports>
Oct 18 07:34:58 user nova-compute[74587]:     </nova:instance>
Oct 18 07:34:58 user nova-compute[74587]:   </metadata>
Oct 18 07:34:58 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:34:58 user nova-compute[74587]:     <system>
Oct 18 07:34:58 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:34:58 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:34:58 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:34:58 user nova-compute[74587]:       <entry name="serial">c850cad2-d127-4a39-bf71-4ca764342164</entry>
Oct 18 07:34:58 user nova-compute[74587]:       <entry name="uuid">c850cad2-d127-4a39-bf71-4ca764342164</entry>
Oct 18 07:34:58 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:34:58 user nova-compute[74587]:     </system>
Oct 18 07:34:58 user nova-compute[74587]:   </sysinfo>
Oct 18 07:34:58 user nova-compute[74587]:   <os>
Oct 18 07:34:58 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:34:58 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:34:58 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:34:58 user nova-compute[74587]:   </os>
Oct 18 07:34:58 user nova-compute[74587]:   <features>
Oct 18 07:34:58 user nova-compute[74587]:     <acpi/>
Oct 18 07:34:58 user nova-compute[74587]:     <apic/>
Oct 18 07:34:58 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:34:58 user nova-compute[74587]:   </features>
Oct 18 07:34:58 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:34:58 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:34:58 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:34:58 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:34:58 user nova-compute[74587]:   </clock>
Oct 18 07:34:58 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:34:58 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:34:58 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:34:58 user nova-compute[74587]:   </cpu>
Oct 18 07:34:58 user nova-compute[74587]:   <devices>
Oct 18 07:34:58 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:34:58 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:34:58 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk"/>
Oct 18 07:34:58 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:34:58 user nova-compute[74587]:     </disk>
Oct 18 07:34:58 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:34:58 user nova-compute[74587]:       <mac address="fa:16:3e:ea:ac:a8"/>
Oct 18 07:34:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:34:58 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:34:58 user nova-compute[74587]:       <target dev="tap6d8b91c9-75"/>
Oct 18 07:34:58 user nova-compute[74587]:     </interface>
Oct 18 07:34:58 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:34:58 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/console.log" append="off"/>
Oct 18 07:34:58 user nova-compute[74587]:     </serial>
Oct 18 07:34:58 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:34:58 user nova-compute[74587]:     <video>
Oct 18 07:34:58 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:34:58 user nova-compute[74587]:     </video>
Oct 18 07:34:58 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:34:58 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:34:58 user nova-compute[74587]:     </rng>
Oct 18 07:34:58 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:34:58 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:34:58 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:34:58 user nova-compute[74587]:     </memballoon>
Oct 18 07:34:58 user nova-compute[74587]:   </devices>
Oct 18 07:34:58 user nova-compute[74587]: </domain>
Oct 18 07:34:58 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1286203425',display_name='tempest-VolumesNegativeTest-instance-1286203425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1286203425',id=44,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6e661fa797e4575aa4f5acd581f302b',ramdisk_id='',reservation_id='r-f857yp83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-475950850',owner_user_name='tempest-VolumesNegativeTest-475950850-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:34:56Z,user_data=None,user_id='7e3cac1f54f34a7c9e5485136df872c4',uuid=c850cad2-d127-4a39-bf71-4ca764342164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "address": "fa:16:3e:ea:ac:a8", "network": {"id": "182cffc6-c674-4641-b988-87d1b288c7ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "21b75bb9de7244cb832931a64959110d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8b91c9-75", "ovs_interfaceid": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Converting VIF {"id": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "address": "fa:16:3e:ea:ac:a8", "network": {"id": "182cffc6-c674-4641-b988-87d1b288c7ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "21b75bb9de7244cb832931a64959110d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8b91c9-75", "ovs_interfaceid": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ac:a8,bridge_name='br-int',has_traffic_filtering=True,id=6d8b91c9-7557-4815-8db6-8f22a41b1e11,network=Network(182cffc6-c674-4641-b988-87d1b288c7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8b91c9-75') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG os_vif [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ac:a8,bridge_name='br-int',has_traffic_filtering=True,id=6d8b91c9-7557-4815-8db6-8f22a41b1e11,network=Network(182cffc6-c674-4641-b988-87d1b288c7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8b91c9-75') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccdc1a34-146a-57fb-97a5-e9a97bf489b3', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d8b91c9-75, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d8b91c9-75, col_values=(('qos', UUID('56646d15-5690-42df-9d87-1d6a9e86ca59')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d8b91c9-75, col_values=(('external_ids', {'iface-id': '6d8b91c9-7557-4815-8db6-8f22a41b1e11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:ac:a8', 'vm-uuid': 'c850cad2-d127-4a39-bf71-4ca764342164'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:34:58 user nova-compute[74587]: INFO os_vif [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ac:a8,bridge_name='br-int',has_traffic_filtering=True,id=6d8b91c9-7557-4815-8db6-8f22a41b1e11,network=Network(182cffc6-c674-4641-b988-87d1b288c7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8b91c9-75')
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] No VIF found with MAC fa:16:3e:ea:ac:a8, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.neutron [req-36c4a7f9-fca7-47a1-91e9-21f2e37dd1ff req-ac227ed6-794a-4457-ba49-c7e44e86dd35 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Updated VIF entry in instance network info cache for port 6d8b91c9-7557-4815-8db6-8f22a41b1e11. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:34:58 user nova-compute[74587]: DEBUG nova.network.neutron [req-36c4a7f9-fca7-47a1-91e9-21f2e37dd1ff req-ac227ed6-794a-4457-ba49-c7e44e86dd35 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Updating instance_info_cache with network_info: [{"id": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "address": "fa:16:3e:ea:ac:a8", "network": {"id": "182cffc6-c674-4641-b988-87d1b288c7ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "21b75bb9de7244cb832931a64959110d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8b91c9-75", "ovs_interfaceid": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:34:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-36c4a7f9-fca7-47a1-91e9-21f2e37dd1ff req-ac227ed6-794a-4457-ba49-c7e44e86dd35 service nova] Releasing lock "refresh_cache-c850cad2-d127-4a39-bf71-4ca764342164" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:34:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-5ee4b5a2-950d-41eb-93c4-0effbcd9d13c req-53efee8f-72d3-4106-8c7f-c628e0854397 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Received event network-vif-plugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5ee4b5a2-950d-41eb-93c4-0effbcd9d13c req-53efee8f-72d3-4106-8c7f-c628e0854397 service nova] Acquiring lock "c850cad2-d127-4a39-bf71-4ca764342164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5ee4b5a2-950d-41eb-93c4-0effbcd9d13c req-53efee8f-72d3-4106-8c7f-c628e0854397 service nova] Lock "c850cad2-d127-4a39-bf71-4ca764342164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5ee4b5a2-950d-41eb-93c4-0effbcd9d13c req-53efee8f-72d3-4106-8c7f-c628e0854397 service nova] Lock "c850cad2-d127-4a39-bf71-4ca764342164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-5ee4b5a2-950d-41eb-93c4-0effbcd9d13c req-53efee8f-72d3-4106-8c7f-c628e0854397 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] No waiting events found dispatching network-vif-plugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:00 user nova-compute[74587]: WARNING nova.compute.manager [req-5ee4b5a2-950d-41eb-93c4-0effbcd9d13c req-53efee8f-72d3-4106-8c7f-c628e0854397 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Received unexpected event network-vif-plugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 for instance with vm_state building and task_state spawning.
Oct 18 07:35:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:35:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:01 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:35:01 user nova-compute[74587]: INFO nova.compute.claims [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Claim successful on node user
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:35:02 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:35:02 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Instance spawned successfully.
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.policy [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '538ad3704d374763a318647b40cac1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47608ab6414451fabf82d9e34c76a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-041798e2-f3f2-4ce1-ac64-eb5fd10b8315 req-9e219aa3-8822-4eca-a084-c7a2ee903b89 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Received event network-vif-plugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-041798e2-f3f2-4ce1-ac64-eb5fd10b8315 req-9e219aa3-8822-4eca-a084-c7a2ee903b89 service nova] Acquiring lock "c850cad2-d127-4a39-bf71-4ca764342164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-041798e2-f3f2-4ce1-ac64-eb5fd10b8315 req-9e219aa3-8822-4eca-a084-c7a2ee903b89 service nova] Lock "c850cad2-d127-4a39-bf71-4ca764342164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-041798e2-f3f2-4ce1-ac64-eb5fd10b8315 req-9e219aa3-8822-4eca-a084-c7a2ee903b89 service nova] Lock "c850cad2-d127-4a39-bf71-4ca764342164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-041798e2-f3f2-4ce1-ac64-eb5fd10b8315 req-9e219aa3-8822-4eca-a084-c7a2ee903b89 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] No waiting events found dispatching network-vif-plugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:02 user nova-compute[74587]: WARNING nova.compute.manager [req-041798e2-f3f2-4ce1-ac64-eb5fd10b8315 req-9e219aa3-8822-4eca-a084-c7a2ee903b89 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Received unexpected event network-vif-plugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 for instance with vm_state building and task_state spawning.
Oct 18 07:35:02 user nova-compute[74587]: INFO nova.compute.manager [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Took 6.27 seconds to spawn the instance on the hypervisor.
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:35:02 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Creating image(s)
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "/opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "/opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "/opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:02 user nova-compute[74587]: INFO nova.compute.manager [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Took 7.08 seconds to build instance.
Oct 18 07:35:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-46c436d5-06ce-47a8-bef8-b7c1da3e2f77 tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "c850cad2-d127-4a39-bf71-4ca764342164" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.176s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.233s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk 1073741824" returned: 0 in 0.059s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Successfully created port: ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Cannot resize image /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Ensure instance console log exists: /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Successfully updated port: ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquired lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-9d00624d-fe72-46c9-8432-2fdf52ddd34f req-ea1acc68-2bb1-4d74-9328-d8031916da44 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-changed-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-9d00624d-fe72-46c9-8432-2fdf52ddd34f req-ea1acc68-2bb1-4d74-9328-d8031916da44 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Refreshing instance network info cache due to event network-changed-ffe8a058-0f56-4b23-8ea8-36915a0014a8. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9d00624d-fe72-46c9-8432-2fdf52ddd34f req-ea1acc68-2bb1-4d74-9328-d8031916da44 service nova] Acquiring lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updating instance_info_cache with network_info: [{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Releasing lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.compute.manager [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance network_info: |[{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9d00624d-fe72-46c9-8432-2fdf52ddd34f req-ea1acc68-2bb1-4d74-9328-d8031916da44 service nova] Acquired lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:35:03 user nova-compute[74587]: DEBUG nova.network.neutron [req-9d00624d-fe72-46c9-8432-2fdf52ddd34f req-ea1acc68-2bb1-4d74-9328-d8031916da44 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Refreshing network info cache for port ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Start _get_guest_xml network_info=[{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:35:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:35:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377656329',display_name='tempest-AttachVolumeTestJSON-server-1377656329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377656329',id=45,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQrfeDFSrh8ZGrOuYYha24ukykHfAOuD917olQ/lsJ8pA5vRSN5Ovrqsa2FwII8i56apAks0xnn4LKfO2tXejfQtuLNK5t/1FIWYyN9LDhAvbM+ogevAPTV3M42nN+uIw==',key_name='tempest-keypair-480105349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-t5gx743d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:35:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=671f2969-e3dc-4696-bfae-c3507e6ca2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.objects.instance [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'pci_devices' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:35:04 user nova-compute[74587]:   <uuid>671f2969-e3dc-4696-bfae-c3507e6ca2b8</uuid>
Oct 18 07:35:04 user nova-compute[74587]:   <name>instance-0000002d</name>
Oct 18 07:35:04 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:35:04 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:35:04 user nova-compute[74587]:   <metadata>
Oct 18 07:35:04 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:35:04 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:35:04 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeTestJSON-server-1377656329</nova:name>
Oct 18 07:35:04 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:35:04</nova:creationTime>
Oct 18 07:35:04 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:35:04 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:35:04 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:35:04 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:35:04 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:35:04 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:35:04 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:35:04 user nova-compute[74587]:       <nova:owner>
Oct 18 07:35:04 user nova-compute[74587]:         <nova:user uuid="538ad3704d374763a318647b40cac1b6">tempest-AttachVolumeTestJSON-42078443-project-member</nova:user>
Oct 18 07:35:04 user nova-compute[74587]:         <nova:project uuid="c47608ab6414451fabf82d9e34c76a94">tempest-AttachVolumeTestJSON-42078443</nova:project>
Oct 18 07:35:04 user nova-compute[74587]:       </nova:owner>
Oct 18 07:35:04 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:35:04 user nova-compute[74587]:       <nova:ports>
Oct 18 07:35:04 user nova-compute[74587]:         <nova:port uuid="ffe8a058-0f56-4b23-8ea8-36915a0014a8">
Oct 18 07:35:04 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 07:35:04 user nova-compute[74587]:         </nova:port>
Oct 18 07:35:04 user nova-compute[74587]:       </nova:ports>
Oct 18 07:35:04 user nova-compute[74587]:     </nova:instance>
Oct 18 07:35:04 user nova-compute[74587]:   </metadata>
Oct 18 07:35:04 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:35:04 user nova-compute[74587]:     <system>
Oct 18 07:35:04 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:35:04 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:35:04 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:35:04 user nova-compute[74587]:       <entry name="serial">671f2969-e3dc-4696-bfae-c3507e6ca2b8</entry>
Oct 18 07:35:04 user nova-compute[74587]:       <entry name="uuid">671f2969-e3dc-4696-bfae-c3507e6ca2b8</entry>
Oct 18 07:35:04 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:35:04 user nova-compute[74587]:     </system>
Oct 18 07:35:04 user nova-compute[74587]:   </sysinfo>
Oct 18 07:35:04 user nova-compute[74587]:   <os>
Oct 18 07:35:04 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:35:04 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:35:04 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:35:04 user nova-compute[74587]:   </os>
Oct 18 07:35:04 user nova-compute[74587]:   <features>
Oct 18 07:35:04 user nova-compute[74587]:     <acpi/>
Oct 18 07:35:04 user nova-compute[74587]:     <apic/>
Oct 18 07:35:04 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:35:04 user nova-compute[74587]:   </features>
Oct 18 07:35:04 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:35:04 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:35:04 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:35:04 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:35:04 user nova-compute[74587]:   </clock>
Oct 18 07:35:04 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:35:04 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:35:04 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:35:04 user nova-compute[74587]:   </cpu>
Oct 18 07:35:04 user nova-compute[74587]:   <devices>
Oct 18 07:35:04 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:35:04 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:35:04 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk"/>
Oct 18 07:35:04 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:35:04 user nova-compute[74587]:     </disk>
Oct 18 07:35:04 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:35:04 user nova-compute[74587]:       <mac address="fa:16:3e:40:13:f8"/>
Oct 18 07:35:04 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:35:04 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:35:04 user nova-compute[74587]:       <target dev="tapffe8a058-0f"/>
Oct 18 07:35:04 user nova-compute[74587]:     </interface>
Oct 18 07:35:04 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:35:04 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/console.log" append="off"/>
Oct 18 07:35:04 user nova-compute[74587]:     </serial>
Oct 18 07:35:04 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:35:04 user nova-compute[74587]:     <video>
Oct 18 07:35:04 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:35:04 user nova-compute[74587]:     </video>
Oct 18 07:35:04 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:35:04 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:35:04 user nova-compute[74587]:     </rng>
Oct 18 07:35:04 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:35:04 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:35:04 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:35:04 user nova-compute[74587]:     </memballoon>
Oct 18 07:35:04 user nova-compute[74587]:   </devices>
Oct 18 07:35:04 user nova-compute[74587]: </domain>
Oct 18 07:35:04 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377656329',display_name='tempest-AttachVolumeTestJSON-server-1377656329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377656329',id=45,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQrfeDFSrh8ZGrOuYYha24ukykHfAOuD917olQ/lsJ8pA5vRSN5Ovrqsa2FwII8i56apAks0xnn4LKfO2tXejfQtuLNK5t/1FIWYyN9LDhAvbM+ogevAPTV3M42nN+uIw==',key_name='tempest-keypair-480105349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-t5gx743d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:35:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=671f2969-e3dc-4696-bfae-c3507e6ca2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG os_vif [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15c00f9b-8ea7-53fa-8b99-a41ea840ca11', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffe8a058-0f, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffe8a058-0f, col_values=(('qos', UUID('db83c5d1-83c2-4448-a284-7283f42b3299')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffe8a058-0f, col_values=(('external_ids', {'iface-id': 'ffe8a058-0f56-4b23-8ea8-36915a0014a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:13:f8', 'vm-uuid': '671f2969-e3dc-4696-bfae-c3507e6ca2b8'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:04 user nova-compute[74587]: INFO os_vif [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f')
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No VIF found with MAC fa:16:3e:40:13:f8, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.network.neutron [req-9d00624d-fe72-46c9-8432-2fdf52ddd34f req-ea1acc68-2bb1-4d74-9328-d8031916da44 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updated VIF entry in instance network info cache for port ffe8a058-0f56-4b23-8ea8-36915a0014a8. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG nova.network.neutron [req-9d00624d-fe72-46c9-8432-2fdf52ddd34f req-ea1acc68-2bb1-4d74-9328-d8031916da44 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updating instance_info_cache with network_info: [{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9d00624d-fe72-46c9-8432-2fdf52ddd34f req-ea1acc68-2bb1-4d74-9328-d8031916da44 service nova] Releasing lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:35:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-943d29d0-1b03-4b1b-af38-8a156e1cf88a req-76a4016a-f7be-4722-91b5-2aab1c78d7b0 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-943d29d0-1b03-4b1b-af38-8a156e1cf88a req-76a4016a-f7be-4722-91b5-2aab1c78d7b0 service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-943d29d0-1b03-4b1b-af38-8a156e1cf88a req-76a4016a-f7be-4722-91b5-2aab1c78d7b0 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-943d29d0-1b03-4b1b-af38-8a156e1cf88a req-76a4016a-f7be-4722-91b5-2aab1c78d7b0 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-943d29d0-1b03-4b1b-af38-8a156e1cf88a req-76a4016a-f7be-4722-91b5-2aab1c78d7b0 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:05 user nova-compute[74587]: WARNING nova.compute.manager [req-943d29d0-1b03-4b1b-af38-8a156e1cf88a req-76a4016a-f7be-4722-91b5-2aab1c78d7b0 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state building and task_state spawning.
Oct 18 07:35:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-5193a605-db2b-4e7a-9806-7924dd4ce800 req-0f0f6acc-fc0e-46ec-91a1-224503a4ca40 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-changed-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-5193a605-db2b-4e7a-9806-7924dd4ce800 req-0f0f6acc-fc0e-46ec-91a1-224503a4ca40 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Refreshing instance network info cache due to event network-changed-2b4a587e-fda7-4b59-9074-241c0cbfe1d9. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5193a605-db2b-4e7a-9806-7924dd4ce800 req-0f0f6acc-fc0e-46ec-91a1-224503a4ca40 service nova] Acquiring lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5193a605-db2b-4e7a-9806-7924dd4ce800 req-0f0f6acc-fc0e-46ec-91a1-224503a4ca40 service nova] Acquired lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG nova.network.neutron [req-5193a605-db2b-4e7a-9806-7924dd4ce800 req-0f0f6acc-fc0e-46ec-91a1-224503a4ca40 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Refreshing network info cache for port 2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "7df5792a-005a-49b9-856f-7758869917fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:06 user nova-compute[74587]: INFO nova.compute.manager [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Terminating instance
Oct 18 07:35:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-6342af5f-34ba-437b-9061-e94fc7df60db req-1e09c284-0f7a-4650-927b-54e91f3e7847 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-vif-unplugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6342af5f-34ba-437b-9061-e94fc7df60db req-1e09c284-0f7a-4650-927b-54e91f3e7847 service nova] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6342af5f-34ba-437b-9061-e94fc7df60db req-1e09c284-0f7a-4650-927b-54e91f3e7847 service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6342af5f-34ba-437b-9061-e94fc7df60db req-1e09c284-0f7a-4650-927b-54e91f3e7847 service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-6342af5f-34ba-437b-9061-e94fc7df60db req-1e09c284-0f7a-4650-927b-54e91f3e7847 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] No waiting events found dispatching network-vif-unplugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-6342af5f-34ba-437b-9061-e94fc7df60db req-1e09c284-0f7a-4650-927b-54e91f3e7847 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-vif-unplugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG nova.network.neutron [req-5193a605-db2b-4e7a-9806-7924dd4ce800 req-0f0f6acc-fc0e-46ec-91a1-224503a4ca40 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updated VIF entry in instance network info cache for port 2b4a587e-fda7-4b59-9074-241c0cbfe1d9. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG nova.network.neutron [req-5193a605-db2b-4e7a-9806-7924dd4ce800 req-0f0f6acc-fc0e-46ec-91a1-224503a4ca40 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating instance_info_cache with network_info: [{"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5193a605-db2b-4e7a-9806-7924dd4ce800 req-0f0f6acc-fc0e-46ec-91a1-224503a4ca40 service nova] Releasing lock "refresh_cache-7df5792a-005a-49b9-856f-7758869917fd" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:35:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Instance destroyed successfully.
Oct 18 07:35:06 user nova-compute[74587]: DEBUG nova.objects.instance [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lazy-loading 'resources' on Instance uuid 7df5792a-005a-49b9-856f-7758869917fd {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T07:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-283849704',display_name='tempest-TestShelveInstance-server-283849704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-283849704',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkABgU+Vcpq23Lp+OOTXqH5YIc95x7QJ6Mj8W3S09rlS/ucKS/KicjYv0xrTlTUuMuVyT5n13nN5l7SLjfOW4c+gXg636Eb6UmCQPbB++Ff6O/AJNy0ajwcVkUyhrnkGg==',key_name='tempest-TestShelveInstance-262530121',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:33:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='341d61f7861f48899f85601e632ed912',ramdisk_id='',reservation_id='r-0u9l9p27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-906083640',owner_user_name='tempest-TestShelveInstance-906083640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:33:46Z,user_data=None,user_id='f7c61f0efc8d462bb809d0f512914342',uuid=7df5792a-005a-49b9-856f-7758869917fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converting VIF {"id": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "address": "fa:16:3e:8e:48:35", "network": {"id": "d816ea72-117e-40fb-aac8-d7450ac3441c", "bridge": "br-int", "label": "tempest-TestShelveInstance-2061319443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341d61f7861f48899f85601e632ed912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b4a587e-fd", "ovs_interfaceid": "2b4a587e-fda7-4b59-9074-241c0cbfe1d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_vif [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b4a587e-fd, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4321389d-4df1-4ffd-bed4-44dcced8f72e) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:35:07 user nova-compute[74587]: INFO os_vif [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:35,bridge_name='br-int',has_traffic_filtering=True,id=2b4a587e-fda7-4b59-9074-241c0cbfe1d9,network=Network(d816ea72-117e-40fb-aac8-d7450ac3441c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b4a587e-fd')
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcYKVTFj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:35:07 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c71405f-dbca-4a5c-991c-8680b1845116]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:35:07 user nova-compute[74587]: No targets found.
Oct 18 07:35:07 user nova-compute[74587]: iSNS:
Oct 18 07:35:07 user nova-compute[74587]: No targets found.
Oct 18 07:35:07 user nova-compute[74587]: STATIC:
Oct 18 07:35:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285
Oct 18 07:35:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:35:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:35:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59
Oct 18 07:35:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:35:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:35:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62
Oct 18 07:35:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:35:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:35:07 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740
Oct 18 07:35:07 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:35:07 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:35:07 user nova-compute[74587]: FIRMWARE:
Oct 18 07:35:07 user nova-compute[74587]: No targets found.
Oct 18 07:35:07 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:35:07 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:35:07 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f4b59f-9b1f-452c-861e-fb5a1ffc777a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[623b06ea-29f0-45b0-a155-989a46d145a0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:07 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:35:07 user nova-compute[74587]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)
Oct 18 07:35:07 user nova-compute[74587]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)
Oct 18 07:35:07 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:07 user nova-compute[74587]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 (non-flash)
Oct 18 07:35:07 user nova-compute[74587]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)
Oct 18 07:35:07 user nova-compute[74587]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)
Oct 18 07:35:07 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe45196c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0964bf0-8980-4f2b-aa2f-f040c80b57b9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[095e9200-dac8-4e4b-8500-dc495e2c6166]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fff85fe-750f-4da7-ae41-44e02fbb41ee]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.075s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e64455a-ebd8-400d-8389-847bf51d08c0]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e39aa8e-bae9-4026-a3f2-99a9e454e32c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6999a33f-2919-4e51-9866-b15c88399474]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260]
Oct 18 07:35:07 user nova-compute[74587]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59, portal: 172.16.0.220,3260] successful.
Oct 18 07:35:07 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[de89fe3b-01eb-4520-868c-7817f01dceb8]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] <== disconnect_volume: return (407ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:35:07 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Deleting instance files /opt/stack/data/nova/instances/7df5792a-005a-49b9-856f-7758869917fd_del
Oct 18 07:35:07 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Deletion of /opt/stack/data/nova/instances/7df5792a-005a-49b9-856f-7758869917fd_del complete
Oct 18 07:35:07 user nova-compute[74587]: INFO nova.compute.manager [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 7df5792a-005a-49b9-856f-7758869917fd] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-d7cc33fa-603f-443d-a51c-2ee3c4481383 req-b94137a7-cf88-446b-baa2-f1174ad100ea service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7cc33fa-603f-443d-a51c-2ee3c4481383 req-b94137a7-cf88-446b-baa2-f1174ad100ea service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7cc33fa-603f-443d-a51c-2ee3c4481383 req-b94137a7-cf88-446b-baa2-f1174ad100ea service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d7cc33fa-603f-443d-a51c-2ee3c4481383 req-b94137a7-cf88-446b-baa2-f1174ad100ea service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-d7cc33fa-603f-443d-a51c-2ee3c4481383 req-b94137a7-cf88-446b-baa2-f1174ad100ea service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:07 user nova-compute[74587]: WARNING nova.compute.manager [req-d7cc33fa-603f-443d-a51c-2ee3c4481383 req-b94137a7-cf88-446b-baa2-f1174ad100ea service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state building and task_state spawning.
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.compute.manager [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:35:07 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance spawned successfully.
Oct 18 07:35:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:35:08 user nova-compute[74587]: INFO nova.compute.manager [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Took 5.58 seconds to spawn the instance on the hypervisor.
Oct 18 07:35:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:35:08 user nova-compute[74587]: INFO nova.compute.manager [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Took 6.34 seconds to build instance.
Oct 18 07:35:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-74d24083-3b2f-4048-9c99-3bcc0153e154 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.432s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-17fd047b-8243-4931-acbb-2b8d9b6ef3f3 req-5ae4a00b-50cd-49be-90b7-125abc58b2ea service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-17fd047b-8243-4931-acbb-2b8d9b6ef3f3 req-5ae4a00b-50cd-49be-90b7-125abc58b2ea service nova] Acquiring lock "7df5792a-005a-49b9-856f-7758869917fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-17fd047b-8243-4931-acbb-2b8d9b6ef3f3 req-5ae4a00b-50cd-49be-90b7-125abc58b2ea service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-17fd047b-8243-4931-acbb-2b8d9b6ef3f3 req-5ae4a00b-50cd-49be-90b7-125abc58b2ea service nova] Lock "7df5792a-005a-49b9-856f-7758869917fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-17fd047b-8243-4931-acbb-2b8d9b6ef3f3 req-5ae4a00b-50cd-49be-90b7-125abc58b2ea service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] No waiting events found dispatching network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:08 user nova-compute[74587]: WARNING nova.compute.manager [req-17fd047b-8243-4931-acbb-2b8d9b6ef3f3 req-5ae4a00b-50cd-49be-90b7-125abc58b2ea service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received unexpected event network-vif-plugged-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 for instance with vm_state active and task_state deleting.
Oct 18 07:35:08 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:08 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Took 1.35 seconds to deallocate network for instance.
Oct 18 07:35:09 user nova-compute[74587]: INFO nova.compute.manager [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Took 0.90 seconds to detach 1 volumes for instance.
Oct 18 07:35:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Deleting volume: e7e4b2ce-4aa1-4619-ba2e-56f9e613fd59 {{(pid=74587) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 07:35:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:10 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Deleted allocations for instance 7df5792a-005a-49b9-856f-7758869917fd
Oct 18 07:35:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-73d67e9b-4865-4542-94d9-a3f851ead214 tempest-TestShelveInstance-906083640 tempest-TestShelveInstance-906083640-project-member] Lock "7df5792a-005a-49b9-856f-7758869917fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.305s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "effe554a-aceb-459e-a45c-6b0a203f8553" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "effe554a-aceb-459e-a45c-6b0a203f8553" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:10 user nova-compute[74587]: INFO nova.compute.manager [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Terminating instance
Oct 18 07:35:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: 7df5792a-005a-49b9-856f-7758869917fd] Received event network-vif-deleted-2b4a587e-fda7-4b59-9074-241c0cbfe1d9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received event network-changed-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Refreshing instance network info cache due to event network-changed-f187e480-b199-46b5-9915-8964a37ba626. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] Acquiring lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] Acquired lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG nova.network.neutron [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Refreshing network info cache for port f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-da37ada0-5461-4a4a-9c8b-b64fe9ae2f95 req-44560bf8-f315-435d-8a65-97b0ffac9386 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received event network-vif-unplugged-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-da37ada0-5461-4a4a-9c8b-b64fe9ae2f95 req-44560bf8-f315-435d-8a65-97b0ffac9386 service nova] Acquiring lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-da37ada0-5461-4a4a-9c8b-b64fe9ae2f95 req-44560bf8-f315-435d-8a65-97b0ffac9386 service nova] Lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-da37ada0-5461-4a4a-9c8b-b64fe9ae2f95 req-44560bf8-f315-435d-8a65-97b0ffac9386 service nova] Lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-da37ada0-5461-4a4a-9c8b-b64fe9ae2f95 req-44560bf8-f315-435d-8a65-97b0ffac9386 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] No waiting events found dispatching network-vif-unplugged-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-da37ada0-5461-4a4a-9c8b-b64fe9ae2f95 req-44560bf8-f315-435d-8a65-97b0ffac9386 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received event network-vif-unplugged-f187e480-b199-46b5-9915-8964a37ba626 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.network.neutron [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Updated VIF entry in instance network info cache for port f187e480-b199-46b5-9915-8964a37ba626. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.network.neutron [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Updating instance_info_cache with network_info: [{"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] Releasing lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received event network-changed-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Refreshing instance network info cache due to event network-changed-f187e480-b199-46b5-9915-8964a37ba626. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] Acquiring lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] Acquired lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.network.neutron [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Refreshing network info cache for port f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:35:11 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Instance destroyed successfully.
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.objects.instance [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lazy-loading 'resources' on Instance uuid effe554a-aceb-459e-a45c-6b0a203f8553 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-597322559',display_name='tempest-TestVolumeBootPattern-server-597322559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-597322559',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrD4QGeTTaMlXZ8vfsMMfK6pzduYaYdY6TtuahCvtTSdq2mzozIo9GLQClLeKc4Krkj+ygZI/TyGPqsgnJukfJMz2PgqlnAY3XlyONEXn8OLnPP3EVD58CNxJh6K+Kl2g==',key_name='tempest-TestVolumeBootPattern-1340892382',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:33:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-cd42cq88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:33:47Z,user_data=None,user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=effe554a-aceb-459e-a45c-6b0a203f8553,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:49,bridge_name='br-int',has_traffic_filtering=True,id=f187e480-b199-46b5-9915-8964a37ba626,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf187e480-b1') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_vif [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:49,bridge_name='br-int',has_traffic_filtering=True,id=f187e480-b199-46b5-9915-8964a37ba626,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf187e480-b1') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf187e480-b1, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24e846ef-3f68-4b82-91e6-ac8bd870cea8) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:35:11 user nova-compute[74587]: INFO os_vif [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:6e:49,bridge_name='br-int',has_traffic_filtering=True,id=f187e480-b199-46b5-9915-8964a37ba626,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf187e480-b1')
Oct 18 07:35:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNWJcGdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:35:11 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3c9276-36c5-4abe-bf38-ff642bc655c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:35:11 user nova-compute[74587]: No targets found.
Oct 18 07:35:11 user nova-compute[74587]: iSNS:
Oct 18 07:35:11 user nova-compute[74587]: No targets found.
Oct 18 07:35:11 user nova-compute[74587]: STATIC:
Oct 18 07:35:11 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285
Oct 18 07:35:11 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:35:11 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:35:11 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62
Oct 18 07:35:11 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:35:11 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:35:11 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740
Oct 18 07:35:11 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:35:11 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:35:11 user nova-compute[74587]: FIRMWARE:
Oct 18 07:35:11 user nova-compute[74587]: No targets found.
Oct 18 07:35:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:35:11 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:35:11 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e83980-6a37-4ab3-93ff-f36fae078f75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d146665-3d4a-4451-88ca-e3c2127b674e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:11 user nova-compute[74587]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)
Oct 18 07:35:11 user nova-compute[74587]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)
Oct 18 07:35:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:11 user nova-compute[74587]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 (non-flash)
Oct 18 07:35:11 user nova-compute[74587]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)
Oct 18 07:35:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4427640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62'): ({'sdd'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Removing single pathed devices sdd {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[764d5f11-f239-4d9b-8125-a45e521a8955]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6fefca-2180-4ad2-85dd-5cdf929ccf5a]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flushing IO for device /dev/sdd {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0657977c-2cf8-4a3e-b011-38633d2478ed]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:35:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[99514975-b03e-4813-bd80-bf7c235173b0]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23665383537616230', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c3fe4f29', '/dev/disk/by-id/scsi-1SCST_BIOc3fe4f29-6e857ab034460626') {{(pid=85802) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb49e635-9085-4404-a414-2ac19a8b3b37]: (4, None) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[76385d5e-b34f-4935-88b6-e3a06a616601]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b29b0f8-2b72-4a2c-8ec9-3987ec82702b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62, portal: 172.16.0.220,3260]
Oct 18 07:35:12 user nova-compute[74587]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62, portal: 172.16.0.220,3260] successful.
Oct 18 07:35:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG nova.network.neutron [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Updated VIF entry in instance network info cache for port f187e480-b199-46b5-9915-8964a37ba626. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG nova.network.neutron [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Updating instance_info_cache with network_info: [{"id": "f187e480-b199-46b5-9915-8964a37ba626", "address": "fa:16:3e:9f:6e:49", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf187e480-b1", "ovs_interfaceid": "f187e480-b199-46b5-9915-8964a37ba626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dd3b2e-6ddf-42f2-9e39-a36e9236da62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b74ce9-550c-4b5a-8cbe-764946ef6bc3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== disconnect_volume: return (465ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:35:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Deleting instance files /opt/stack/data/nova/instances/effe554a-aceb-459e-a45c-6b0a203f8553_del
Oct 18 07:35:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Deletion of /opt/stack/data/nova/instances/effe554a-aceb-459e-a45c-6b0a203f8553_del complete
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1ad6d5cf-ac7d-41dc-aa2e-98ae3ed602f4 req-12807d6e-8aeb-45cc-9d0e-7adcec0a3299 service nova] Releasing lock "refresh_cache-effe554a-aceb-459e-a45c-6b0a203f8553" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:35:12 user nova-compute[74587]: INFO nova.compute.manager [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Took 1.65 seconds to destroy the instance on the hypervisor.
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:12 user nova-compute[74587]: INFO nova.compute.manager [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Detaching volume 579b82b2-031c-4428-a6c9-19a01263d285
Oct 18 07:35:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:12 user nova-compute[74587]: INFO nova.virt.block_device [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Attempting to driver detach volume 579b82b2-031c-4428-a6c9-19a01263d285 from mountpoint /dev/vdb
Oct 18 07:35:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Attempting to detach device vdb from instance 03838929-5ebc-4590-98e4-0b8dfa6d4570 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:35:12 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:35:12 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:35:12 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:35:12 user nova-compute[74587]:   <serial>579b82b2-031c-4428-a6c9-19a01263d285</serial>
Oct 18 07:35:12 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:35:12 user nova-compute[74587]: </disk>
Oct 18 07:35:12 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:35:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Successfully detached device vdb from instance 03838929-5ebc-4590-98e4-0b8dfa6d4570 from the persistent domain config.
Oct 18 07:35:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03838929-5ebc-4590-98e4-0b8dfa6d4570 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:35:12 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:35:12 user nova-compute[74587]:   <source dev="/dev/sde"/>
Oct 18 07:35:12 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:35:12 user nova-compute[74587]:   <serial>579b82b2-031c-4428-a6c9-19a01263d285</serial>
Oct 18 07:35:12 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:35:12 user nova-compute[74587]: </disk>
Oct 18 07:35:12 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:35:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:13 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-cb0cedcb-5079-4320-bdf7-7f96875520e7 req-fcb7ca61-3f35-4f7e-b0cd-ea532cf92088 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received event network-vif-plugged-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cb0cedcb-5079-4320-bdf7-7f96875520e7 req-fcb7ca61-3f35-4f7e-b0cd-ea532cf92088 service nova] Acquiring lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cb0cedcb-5079-4320-bdf7-7f96875520e7 req-fcb7ca61-3f35-4f7e-b0cd-ea532cf92088 service nova] Lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cb0cedcb-5079-4320-bdf7-7f96875520e7 req-fcb7ca61-3f35-4f7e-b0cd-ea532cf92088 service nova] Lock "effe554a-aceb-459e-a45c-6b0a203f8553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-cb0cedcb-5079-4320-bdf7-7f96875520e7 req-fcb7ca61-3f35-4f7e-b0cd-ea532cf92088 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] No waiting events found dispatching network-vif-plugged-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:13 user nova-compute[74587]: WARNING nova.compute.manager [req-cb0cedcb-5079-4320-bdf7-7f96875520e7 req-fcb7ca61-3f35-4f7e-b0cd-ea532cf92088 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received unexpected event network-vif-plugged-f187e480-b199-46b5-9915-8964a37ba626 for instance with vm_state active and task_state deleting.
Oct 18 07:35:13 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Took 0.79 seconds to deallocate network for instance.
Oct 18 07:35:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-3c6bfa01-e851-4fff-9899-cfc88a5e8c5a req-ab99f1e0-d69b-4164-85df-b820c6f1e255 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Received event network-vif-deleted-f187e480-b199-46b5-9915-8964a37ba626 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:13 user nova-compute[74587]: INFO nova.compute.manager [req-3c6bfa01-e851-4fff-9899-cfc88a5e8c5a req-ab99f1e0-d69b-4164-85df-b820c6f1e255 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Neutron deleted interface f187e480-b199-46b5-9915-8964a37ba626; detaching it from the instance and deleting it from the info cache
Oct 18 07:35:13 user nova-compute[74587]: DEBUG nova.network.neutron [req-3c6bfa01-e851-4fff-9899-cfc88a5e8c5a req-ab99f1e0-d69b-4164-85df-b820c6f1e255 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03838929-5ebc-4590-98e4-0b8dfa6d4570 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:35:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-3c6bfa01-e851-4fff-9899-cfc88a5e8c5a req-ab99f1e0-d69b-4164-85df-b820c6f1e255 service nova] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Detach interface failed, port_id=f187e480-b199-46b5-9915-8964a37ba626, reason: Instance effe554a-aceb-459e-a45c-6b0a203f8553 could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:35:14 user nova-compute[74587]: INFO nova.compute.manager [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: effe554a-aceb-459e-a45c-6b0a203f8553] Took 1.10 seconds to detach 1 volumes for instance.
Oct 18 07:35:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:14 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:35:14 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:35:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:14 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Deleted allocations for instance effe554a-aceb-459e-a45c-6b0a203f8553
Oct 18 07:35:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-689b7ff0-f8cd-4fba-83f5-61763bffaad5 tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "effe554a-aceb-459e-a45c-6b0a203f8553" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.135s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:19 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'flavor' on Instance uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:35:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:19 user nova-compute[74587]: INFO nova.compute.manager [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Attaching volume d1582691-356c-4a6d-a418-eaf951033292 to /dev/vdb
Oct 18 07:35:20 user nova-compute[74587]: DEBUG os_brick.utils [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0378194-cbaa-48fb-abd5-c0d98229fcba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c92d615-2943-42da-bc0f-3ccc3fe4016a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1210af93-e1a1-4bce-b9da-3728911f7267]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e839b8-476c-489b-99fe-219c0f4f3ed9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:35:20 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:35:20 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b11935f-d9ed-4496-9e25-11aaab63f952]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG os_brick.utils [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:35:20 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updating existing volume attachment record: 8f444b88-0caf-4634-a3cd-530217a591c3 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:35:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:35:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG nova.compute.manager [req-496ccb61-f4a6-4a88-a4e2-fba0d26ca92d req-dd3dc5f7-4063-4d5b-a820-5b630e91b051 service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received event network-changed-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG nova.compute.manager [req-496ccb61-f4a6-4a88-a4e2-fba0d26ca92d req-dd3dc5f7-4063-4d5b-a820-5b630e91b051 service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Refreshing instance network info cache due to event network-changed-9cff095f-7779-4f55-994c-1d42901b058f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-496ccb61-f4a6-4a88-a4e2-fba0d26ca92d req-dd3dc5f7-4063-4d5b-a820-5b630e91b051 service nova] Acquiring lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-496ccb61-f4a6-4a88-a4e2-fba0d26ca92d req-dd3dc5f7-4063-4d5b-a820-5b630e91b051 service nova] Acquired lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-496ccb61-f4a6-4a88-a4e2-fba0d26ca92d req-dd3dc5f7-4063-4d5b-a820-5b630e91b051 service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Refreshing network info cache for port 9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG nova.objects.instance [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lazy-loading 'flavor' on Instance uuid ea414a0e-7538-4490-8b78-76b852ea4214 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-496ccb61-f4a6-4a88-a4e2-fba0d26ca92d req-dd3dc5f7-4063-4d5b-a820-5b630e91b051 service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updated VIF entry in instance network info cache for port 9cff095f-7779-4f55-994c-1d42901b058f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-496ccb61-f4a6-4a88-a4e2-fba0d26ca92d req-dd3dc5f7-4063-4d5b-a820-5b630e91b051 service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updating instance_info_cache with network_info: [{"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-496ccb61-f4a6-4a88-a4e2-fba0d26ca92d req-dd3dc5f7-4063-4d5b-a820-5b630e91b051 service nova] Releasing lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:26 user nova-compute[74587]: INFO nova.compute.manager [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Attaching volume fe88d9e5-574d-4705-af81-df50182a2d63 to /dev/vdb
Oct 18 07:35:26 user nova-compute[74587]: DEBUG os_brick.utils [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[47435110-78f0-4aa2-a4f7-baf5f54e44f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23c6b14-fca4-45f9-a88b-98cdc4c1cd52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78a7146-b7ae-4b2b-82ce-017e9570ce74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75a2a65-8e8e-4db5-ac3c-ccd32e06bca1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:35:26 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:35:26 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4465425-f3bd-49cf-9a75-d54c929b1695]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG os_brick.utils [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:35:26 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updating existing volume attachment record: 2f517a75-4887-4efd-b1e5-aa3736d720bc {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:35:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:35:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "071cfc59-d9ec-4641-a3da-6e32454a4f37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:27 user nova-compute[74587]: INFO nova.compute.manager [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Terminating instance
Oct 18 07:35:27 user nova-compute[74587]: DEBUG nova.compute.manager [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-6f26ad0c-5828-422e-be16-0131210ee267 req-d88552c5-a8a7-44ee-94b2-344637e28c5b service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Received event network-vif-unplugged-788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6f26ad0c-5828-422e-be16-0131210ee267 req-d88552c5-a8a7-44ee-94b2-344637e28c5b service nova] Acquiring lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6f26ad0c-5828-422e-be16-0131210ee267 req-d88552c5-a8a7-44ee-94b2-344637e28c5b service nova] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6f26ad0c-5828-422e-be16-0131210ee267 req-d88552c5-a8a7-44ee-94b2-344637e28c5b service nova] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-6f26ad0c-5828-422e-be16-0131210ee267 req-d88552c5-a8a7-44ee-94b2-344637e28c5b service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] No waiting events found dispatching network-vif-unplugged-788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-6f26ad0c-5828-422e-be16-0131210ee267 req-d88552c5-a8a7-44ee-94b2-344637e28c5b service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Received event network-vif-unplugged-788228f5-6240-41f4-9d7b-e9757d227a66 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:35:28 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Instance destroyed successfully.
Oct 18 07:35:28 user nova-compute[74587]: DEBUG nova.objects.instance [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lazy-loading 'resources' on Instance uuid 071cfc59-d9ec-4641-a3da-6e32454a4f37 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-780846111',display_name='tempest-VolumesActionsTest-instance-780846111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-780846111',id=43,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbd18e7251dc4276a18772e1cd48276f',ramdisk_id='',reservation_id='r-y0asnl6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-496843029',owner_user_name='tempest-VolumesActionsTest-496843029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:33:47Z,user_data=None,user_id='427c1bee6dd74c388e98bfd44ecf7061',uuid=071cfc59-d9ec-4641-a3da-6e32454a4f37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "788228f5-6240-41f4-9d7b-e9757d227a66", "address": "fa:16:3e:1f:3e:a3", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788228f5-62", "ovs_interfaceid": "788228f5-6240-41f4-9d7b-e9757d227a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converting VIF {"id": "788228f5-6240-41f4-9d7b-e9757d227a66", "address": "fa:16:3e:1f:3e:a3", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788228f5-62", "ovs_interfaceid": "788228f5-6240-41f4-9d7b-e9757d227a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:a3,bridge_name='br-int',has_traffic_filtering=True,id=788228f5-6240-41f4-9d7b-e9757d227a66,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788228f5-62') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG os_vif [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:a3,bridge_name='br-int',has_traffic_filtering=True,id=788228f5-6240-41f4-9d7b-e9757d227a66,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788228f5-62') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap788228f5-62, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27251146-345d-44ce-b880-5ae390741f77) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:28 user nova-compute[74587]: INFO os_vif [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:a3,bridge_name='br-int',has_traffic_filtering=True,id=788228f5-6240-41f4-9d7b-e9757d227a66,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788228f5-62')
Oct 18 07:35:28 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Deleting instance files /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37_del
Oct 18 07:35:28 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Deletion of /opt/stack/data/nova/instances/071cfc59-d9ec-4641-a3da-6e32454a4f37_del complete
Oct 18 07:35:28 user nova-compute[74587]: INFO nova.compute.manager [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 18 07:35:28 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:35:28 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:35:29 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:29 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Took 0.52 seconds to deallocate network for instance.
Oct 18 07:35:29 user nova-compute[74587]: DEBUG nova.compute.manager [req-450ab158-e02b-4938-866d-ac42c1d3bcc9 req-54bdbc1e-f236-48d9-a774-7d4cdf14326f service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Received event network-vif-deleted-788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:29 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:35:29 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:35:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:29 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Deleted allocations for instance 071cfc59-d9ec-4641-a3da-6e32454a4f37
Oct 18 07:35:29 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d44524f7-0bcb-4a5c-a020-e1dd0db363d3 tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.864s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-1952d9e0-04e4-46c2-801f-c97c1c016658 req-9fa6c669-4f24-44f3-a687-c6e360b30518 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Received event network-vif-plugged-788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1952d9e0-04e4-46c2-801f-c97c1c016658 req-9fa6c669-4f24-44f3-a687-c6e360b30518 service nova] Acquiring lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1952d9e0-04e4-46c2-801f-c97c1c016658 req-9fa6c669-4f24-44f3-a687-c6e360b30518 service nova] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-1952d9e0-04e4-46c2-801f-c97c1c016658 req-9fa6c669-4f24-44f3-a687-c6e360b30518 service nova] Lock "071cfc59-d9ec-4641-a3da-6e32454a4f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-1952d9e0-04e4-46c2-801f-c97c1c016658 req-9fa6c669-4f24-44f3-a687-c6e360b30518 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] No waiting events found dispatching network-vif-plugged-788228f5-6240-41f4-9d7b-e9757d227a66 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:30 user nova-compute[74587]: WARNING nova.compute.manager [req-1952d9e0-04e4-46c2-801f-c97c1c016658 req-9fa6c669-4f24-44f3-a687-c6e360b30518 service nova] [instance: 071cfc59-d9ec-4641-a3da-6e32454a4f37] Received unexpected event network-vif-plugged-788228f5-6240-41f4-9d7b-e9757d227a66 for instance with vm_state deleted and task_state None.
Oct 18 07:35:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:35:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:35:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:33 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03838929-5ebc-4590-98e4-0b8dfa6d4570 is timed out.
Oct 18 07:35:33 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Successfully detached device vdb from instance 03838929-5ebc-4590-98e4-0b8dfa6d4570 from the live domain config.
Oct 18 07:35:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyDuoHag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:35:33 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[028353cb-7a7d-403d-bf45-531deddaae2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:35:33 user nova-compute[74587]: No targets found.
Oct 18 07:35:33 user nova-compute[74587]: iSNS:
Oct 18 07:35:33 user nova-compute[74587]: No targets found.
Oct 18 07:35:33 user nova-compute[74587]: STATIC:
Oct 18 07:35:33 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285
Oct 18 07:35:33 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:35:33 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:35:33 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740
Oct 18 07:35:33 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:35:33 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:35:33 user nova-compute[74587]: FIRMWARE:
Oct 18 07:35:33 user nova-compute[74587]: No targets found.
Oct 18 07:35:33 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:35:33 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:35:33 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b906b3e5-3f48-443b-be4d-66c4a1c01419]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d5b82a-7cc5-4c7d-9611-1716e7b329d5]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:33 user nova-compute[74587]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)
Oct 18 07:35:33 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:33 user nova-compute[74587]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 (non-flash)
Oct 18 07:35:33 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46e5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285'): ({'sde'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Removing single pathed devices sde {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac74178d-3404-47fc-8e5c-8e428504b101]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1bc4f1-d63f-4375-ab17-b975f41c9e86]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Flushing IO for device /dev/sde {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f036c0e-4da0-4f5a-92ad-195a22199a13]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa93dcb8-2c1b-4104-a65f-918b2142d7b8]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] SCSI volumes sde have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac442700-8341-4da0-a167-9059cf48b7b9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5922945-d854-4184-ac0e-0ea3fe8bc8e5]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285, portal: 172.16.0.220,3260]
Oct 18 07:35:33 user nova-compute[74587]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285, portal: 172.16.0.220,3260] successful.
Oct 18 07:35:33 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a336199-78e3-4a2b-a7f0-378521b57256]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] <== disconnect_volume: return (301ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:35:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG nova.objects.instance [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lazy-loading 'flavor' on Instance uuid 03838929-5ebc-4590-98e4-0b8dfa6d4570 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5ffeff75-9470-47a9-9532-5fc145e0ac5c tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.914s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.777s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:34 user nova-compute[74587]: INFO nova.compute.manager [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Terminating instance
Oct 18 07:35:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-f0f4a9cb-9e7b-4747-b2ea-3978c7783543 req-f621889f-642b-4d89-9557-9f8419ca667d service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received event network-vif-unplugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f0f4a9cb-9e7b-4747-b2ea-3978c7783543 req-f621889f-642b-4d89-9557-9f8419ca667d service nova] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f0f4a9cb-9e7b-4747-b2ea-3978c7783543 req-f621889f-642b-4d89-9557-9f8419ca667d service nova] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f0f4a9cb-9e7b-4747-b2ea-3978c7783543 req-f621889f-642b-4d89-9557-9f8419ca667d service nova] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-f0f4a9cb-9e7b-4747-b2ea-3978c7783543 req-f621889f-642b-4d89-9557-9f8419ca667d service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] No waiting events found dispatching network-vif-unplugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-f0f4a9cb-9e7b-4747-b2ea-3978c7783543 req-f621889f-642b-4d89-9557-9f8419ca667d service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received event network-vif-unplugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:35:35 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Instance destroyed successfully.
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.objects.instance [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lazy-loading 'resources' on Instance uuid 03838929-5ebc-4590-98e4-0b8dfa6d4570 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1279404326',display_name='tempest-VolumesSnapshotTestJSON-instance-1279404326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1279404326',id=39,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa+Ue/9g1B+Dv7Fq1y1h+/UAJT1IoJRIdRI1glnYDMkD0F/nJzElJUZYOkG8TZTCYjyhbccoS9dO+YpCmXR4BNbCjvvCq1O5uPqJ3yMps6VJIFZBo55epOXSTXaFPwHAQ==',key_name='tempest-keypair-1576810152',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afab563ad8cb49e58767661bbe79ffd3',ramdisk_id='',reservation_id='r-176grjhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1818933927',owner_user_name='tempest-VolumesSnapshotTestJSON-1818933927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623d2be80c4c4d71acf62880b712b376',uuid=03838929-5ebc-4590-98e4-0b8dfa6d4570,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converting VIF {"id": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "address": "fa:16:3e:e8:9c:0b", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba393f25-09", "ovs_interfaceid": "ba393f25-09d5-4778-9e2b-daba0edc41d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=ba393f25-09d5-4778-9e2b-daba0edc41d6,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba393f25-09') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_vif [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=ba393f25-09d5-4778-9e2b-daba0edc41d6,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba393f25-09') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba393f25-09, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19abcc0b-3749-4733-82f6-d8910a086f0c) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:35 user nova-compute[74587]: INFO os_vif [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=ba393f25-09d5-4778-9e2b-daba0edc41d6,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba393f25-09')
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyDuoHag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:35:35 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[582f17a3-6f82-4509-8a6d-bc368e2ba0b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:35:35 user nova-compute[74587]: No targets found.
Oct 18 07:35:35 user nova-compute[74587]: iSNS:
Oct 18 07:35:35 user nova-compute[74587]: No targets found.
Oct 18 07:35:35 user nova-compute[74587]: STATIC:
Oct 18 07:35:35 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740
Oct 18 07:35:35 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:35:35 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:35:35 user nova-compute[74587]: FIRMWARE:
Oct 18 07:35:35 user nova-compute[74587]: No targets found.
Oct 18 07:35:35 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:35:35 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:35:35 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:579b82b2-031c-4428-a6c9-19a01263d285', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5cb0dd-c90b-498b-a616-9243cbafb5a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14aa2c3-68dc-4f2e-9da2-89ba7be0d28c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:35 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:35 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4506290>, {}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Disconnecting from: [] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] <== disconnect_volume: return (68ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:35:35 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Deleting instance files /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570_del
Oct 18 07:35:35 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Deletion of /opt/stack/data/nova/instances/03838929-5ebc-4590-98e4-0b8dfa6d4570_del complete
Oct 18 07:35:35 user nova-compute[74587]: INFO nova.compute.manager [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updating instance_info_cache with network_info: [{"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:35:35 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:35 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Took 0.72 seconds to deallocate network for instance.
Oct 18 07:35:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-e75f9203-4793-49c2-b01a-271b4f808f3f req-9942a6fe-7ea5-4884-8d1f-79d88a27b481 service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received event network-vif-deleted-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:36 user nova-compute[74587]: WARNING nova.volume.cinder [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Attachment 38e1ec36-4497-4628-b8f0-8a82eabf8012 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 38e1ec36-4497-4628-b8f0-8a82eabf8012. (HTTP 404) (Request-ID: req-4115c10f-5fae-4257-a264-371a1f4e076b)
Oct 18 07:35:36 user nova-compute[74587]: INFO nova.compute.manager [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Took 0.02 seconds to detach 1 volumes for instance.
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:36 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Deleted allocations for instance 03838929-5ebc-4590-98e4-0b8dfa6d4570
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-ee778974-9a77-4787-9b50-99e9429dfc03 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.039s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-dd6c8824-61c8-4437-8dab-6497b5fde7b5 req-a4ae9161-3383-4109-b63f-782325fdad5b service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received event network-vif-plugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dd6c8824-61c8-4437-8dab-6497b5fde7b5 req-a4ae9161-3383-4109-b63f-782325fdad5b service nova] Acquiring lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dd6c8824-61c8-4437-8dab-6497b5fde7b5 req-a4ae9161-3383-4109-b63f-782325fdad5b service nova] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-dd6c8824-61c8-4437-8dab-6497b5fde7b5 req-a4ae9161-3383-4109-b63f-782325fdad5b service nova] Lock "03838929-5ebc-4590-98e4-0b8dfa6d4570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-dd6c8824-61c8-4437-8dab-6497b5fde7b5 req-a4ae9161-3383-4109-b63f-782325fdad5b service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] No waiting events found dispatching network-vif-plugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:35:36 user nova-compute[74587]: WARNING nova.compute.manager [req-dd6c8824-61c8-4437-8dab-6497b5fde7b5 req-a4ae9161-3383-4109-b63f-782325fdad5b service nova] [instance: 03838929-5ebc-4590-98e4-0b8dfa6d4570] Received unexpected event network-vif-plugged-ba393f25-09d5-4778-9e2b-daba0edc41d6 for instance with vm_state deleted and task_state None.
Oct 18 07:35:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFMTQSws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:35:36 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:35:36 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:35:36 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a870d439-0358-49a5-a94b-fc096a6cbe42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:35:36 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef225e44-1b5c-4101-8346-689fd268ebb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292] added
Oct 18 07:35:36 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6cf3b3-a582-4e1d-afb5-95e3906ef001]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec97c4a-983f-495d-8cfc-f730879ba7df]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFMTQSws {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFMTQSws" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[85994f27-9509-41e7-b40b-fc4fe0e81f73]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OFMTQSws'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb791fc-3a6b-42ef-906c-660a244d82b2]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eff802-33a2-4057-8a2a-6bdb7d4c7504]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34ef570-7d6b-4244-a5db-9ad1104895e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260]
Oct 18 07:35:37 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260] successful.
Oct 18 07:35:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[95250b00-8f3e-4a47-9ef8-8e91619c36e6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6399c390-ef4a-4c37-95eb-c561b9994bcb]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:37 user nova-compute[74587]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:35:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:37 user nova-compute[74587]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:35:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce46a7de-21c8-4f48-896f-8814ab3a00f1]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFMTQSws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23064653965623164', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064653965623164', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'flavor' on Instance uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:35:38 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:35:38 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:35:38 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:35:38 user nova-compute[74587]:   <serial>d1582691-356c-4a6d-a418-eaf951033292</serial>
Oct 18 07:35:38 user nova-compute[74587]: </disk>
Oct 18 07:35:38 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] No VIF found with MAC fa:16:3e:09:de:b0, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e6dedb9f-8cb6-4e8a-8d65-92ac8151c08e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.943s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:39 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:35:39 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8006MB free_disk=25.119686126708984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 79f2ca30-3797-41a4-bbb2-3431bedbf8f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ea414a0e-7538-4490-8b78-76b852ea4214 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance c850cad2-d127-4a39-bf71-4ca764342164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:35:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:35:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQIfHoUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:35:43 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:35:43 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:35:43 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[92286e47-7a64-406b-9190-48d1a0d82d0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:35:43 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e543cd-c0f3-464d-afbf-883452fffa6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63] added
Oct 18 07:35:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[15366f6f-1245-4f55-af8c-3ee09dffc33f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe76996-f78c-4f50-a420-1f51256865ea]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQIfHoUP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQIfHoUP" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad36d6b9-e438-4f7c-bfd5-470fd54d0571]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gQIfHoUP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.072s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[846c10ef-ce1d-4bad-a3a9-86c825602e9d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6852cf4-7485-40e4-9d86-c761fc4a6723]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:43 user nova-compute[74587]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:35:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:43 user nova-compute[74587]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:35:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fafae05-54e2-4381-8082-f9e191eec5f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63, portal: 172.16.0.220,3260]
Oct 18 07:35:43 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63, portal: 172.16.0.220,3260] successful.
Oct 18 07:35:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c7f8e8-c950-4a06-bc0c-725f1e70a09a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[08758ec5-f386-4f3b-b730-0cb55df6f63a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:43 user nova-compute[74587]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:35:43 user nova-compute[74587]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)
Oct 18 07:35:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:35:43 user nova-compute[74587]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:35:43 user nova-compute[74587]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)
Oct 18 07:35:43 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfc814a-e7ce-4381-bdf2-eebab3368770]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:35:43 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQIfHoUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:35:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:35:44 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23432356339376364', 'path': '/dev/sdd'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:35:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432356339376364', 'path': '/dev/sdd'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:35:44 user nova-compute[74587]: DEBUG nova.objects.instance [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lazy-loading 'flavor' on Instance uuid ea414a0e-7538-4490-8b78-76b852ea4214 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:35:44 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:35:44 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:35:44 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:35:44 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:35:44 user nova-compute[74587]:   <serial>fe88d9e5-574d-4705-af81-df50182a2d63</serial>
Oct 18 07:35:44 user nova-compute[74587]: </disk>
Oct 18 07:35:44 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:35:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:35:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:35:45 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] No VIF found with MAC fa:16:3e:9e:f9:46, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:35:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-572deb77-73a8-4bb2-aca8-a8ae8785e92c tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.905s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:35:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:35:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:35:48 user nova-compute[74587]: INFO nova.compute.manager [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Detaching volume fe88d9e5-574d-4705-af81-df50182a2d63
Oct 18 07:35:48 user nova-compute[74587]: INFO nova.virt.block_device [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Attempting to driver detach volume fe88d9e5-574d-4705-af81-df50182a2d63 from mountpoint /dev/vdb
Oct 18 07:35:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Attempting to detach device vdb from instance ea414a0e-7538-4490-8b78-76b852ea4214 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:35:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:35:48 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:35:48 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:35:48 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:35:48 user nova-compute[74587]:   <serial>fe88d9e5-574d-4705-af81-df50182a2d63</serial>
Oct 18 07:35:48 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:35:48 user nova-compute[74587]: </disk>
Oct 18 07:35:48 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:35:48 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Successfully detached device vdb from instance ea414a0e-7538-4490-8b78-76b852ea4214 from the persistent domain config.
Oct 18 07:35:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea414a0e-7538-4490-8b78-76b852ea4214 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:35:48 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:35:48 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:35:48 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:35:48 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:35:48 user nova-compute[74587]:   <serial>fe88d9e5-574d-4705-af81-df50182a2d63</serial>
Oct 18 07:35:48 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:35:48 user nova-compute[74587]: </disk>
Oct 18 07:35:48 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:35:49 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea414a0e-7538-4490-8b78-76b852ea4214 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:35:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-19cee08a-dae7-48f6-be83-93311e0c058a req-88a9539c-cb86-4582-a086-e3f0dd678bb6 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-changed-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-19cee08a-dae7-48f6-be83-93311e0c058a req-88a9539c-cb86-4582-a086-e3f0dd678bb6 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Refreshing instance network info cache due to event network-changed-2e4c6cdf-26f0-4096-a605-7161eda14b7d. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:35:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-19cee08a-dae7-48f6-be83-93311e0c058a req-88a9539c-cb86-4582-a086-e3f0dd678bb6 service nova] Acquiring lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:35:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-19cee08a-dae7-48f6-be83-93311e0c058a req-88a9539c-cb86-4582-a086-e3f0dd678bb6 service nova] Acquired lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:35:51 user nova-compute[74587]: DEBUG nova.network.neutron [req-19cee08a-dae7-48f6-be83-93311e0c058a req-88a9539c-cb86-4582-a086-e3f0dd678bb6 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Refreshing network info cache for port 2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:35:51 user nova-compute[74587]: DEBUG nova.network.neutron [req-19cee08a-dae7-48f6-be83-93311e0c058a req-88a9539c-cb86-4582-a086-e3f0dd678bb6 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updated VIF entry in instance network info cache for port 2e4c6cdf-26f0-4096-a605-7161eda14b7d. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:35:51 user nova-compute[74587]: DEBUG nova.network.neutron [req-19cee08a-dae7-48f6-be83-93311e0c058a req-88a9539c-cb86-4582-a086-e3f0dd678bb6 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updating instance_info_cache with network_info: [{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-19cee08a-dae7-48f6-be83-93311e0c058a req-88a9539c-cb86-4582-a086-e3f0dd678bb6 service nova] Releasing lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:35:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:53 user nova-compute[74587]: DEBUG nova.compute.manager [req-47d5b2f6-b2d9-496a-88b8-beb8ce6e30d8 req-afe46293-9b78-4cd8-917d-71b458a939ef service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-changed-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:35:53 user nova-compute[74587]: DEBUG nova.compute.manager [req-47d5b2f6-b2d9-496a-88b8-beb8ce6e30d8 req-afe46293-9b78-4cd8-917d-71b458a939ef service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Refreshing instance network info cache due to event network-changed-2e4c6cdf-26f0-4096-a605-7161eda14b7d. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:35:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-47d5b2f6-b2d9-496a-88b8-beb8ce6e30d8 req-afe46293-9b78-4cd8-917d-71b458a939ef service nova] Acquiring lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:35:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-47d5b2f6-b2d9-496a-88b8-beb8ce6e30d8 req-afe46293-9b78-4cd8-917d-71b458a939ef service nova] Acquired lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:35:53 user nova-compute[74587]: DEBUG nova.network.neutron [req-47d5b2f6-b2d9-496a-88b8-beb8ce6e30d8 req-afe46293-9b78-4cd8-917d-71b458a939ef service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Refreshing network info cache for port 2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:35:53 user nova-compute[74587]: DEBUG nova.network.neutron [req-47d5b2f6-b2d9-496a-88b8-beb8ce6e30d8 req-afe46293-9b78-4cd8-917d-71b458a939ef service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updated VIF entry in instance network info cache for port 2e4c6cdf-26f0-4096-a605-7161eda14b7d. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:35:53 user nova-compute[74587]: DEBUG nova.network.neutron [req-47d5b2f6-b2d9-496a-88b8-beb8ce6e30d8 req-afe46293-9b78-4cd8-917d-71b458a939ef service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updating instance_info_cache with network_info: [{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:35:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-47d5b2f6-b2d9-496a-88b8-beb8ce6e30d8 req-afe46293-9b78-4cd8-917d-71b458a939ef service nova] Releasing lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:35:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:35:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:02 user nova-compute[74587]: INFO nova.compute.manager [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Rebooting instance
Oct 18 07:36:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:36:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquired lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:36:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:36:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updating instance_info_cache with network_info: [{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Releasing lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-5bf92e90-5108-42f3-8b7d-595e0fa4102d req-d2932417-b844-4d2b-8717-a053cc9e0a0c service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-unplugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5bf92e90-5108-42f3-8b7d-595e0fa4102d req-d2932417-b844-4d2b-8717-a053cc9e0a0c service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5bf92e90-5108-42f3-8b7d-595e0fa4102d req-d2932417-b844-4d2b-8717-a053cc9e0a0c service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5bf92e90-5108-42f3-8b7d-595e0fa4102d req-d2932417-b844-4d2b-8717-a053cc9e0a0c service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-5bf92e90-5108-42f3-8b7d-595e0fa4102d req-d2932417-b844-4d2b-8717-a053cc9e0a0c service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-unplugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:03 user nova-compute[74587]: WARNING nova.compute.manager [req-5bf92e90-5108-42f3-8b7d-595e0fa4102d req-d2932417-b844-4d2b-8717-a053cc9e0a0c service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-unplugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state active and task_state reboot_started_hard.
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Instance destroyed successfully.
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'resources' on Instance uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-861854339',display_name='tempest-TestMinimumBasicScenario-server-861854339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-861854339',id=41,image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESO/HS+ngbf9m2R4QevHaLg9eF5LtfqQ/LJiD+Pa2pv6GjsOL27HsCrgWpTrae7xY7SYx9GbA91Xb21TM8prj4ufDJJfXX5LaXtsbKnImomtXI4oBhTWmoqDMrfvcUBJQ==',key_name='tempest-TestMinimumBasicScenario-1418151160',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e35a447ffe7c47b0963dc60edd4b926a',ramdisk_id='',reservation_id='r-7exmo5di',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-795187138',owner_user_name='tempest-TestMinimumBasicScenario-795187138-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:36:03Z,user_data=None,user_id='51902e137d224e428fba578e2e535656',uuid=feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converting VIF {"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_vif [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e4c6cdf-26, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4da67245-2972-4c3a-bbe0-bb5dc33ce2a0) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: INFO os_vif [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26')
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFMTQSws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:36:04 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baac2d7-4979-4ee1-b752-3667dbb2958d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:36:04 user nova-compute[74587]: No targets found.
Oct 18 07:36:04 user nova-compute[74587]: iSNS:
Oct 18 07:36:04 user nova-compute[74587]: No targets found.
Oct 18 07:36:04 user nova-compute[74587]: STATIC:
Oct 18 07:36:04 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292
Oct 18 07:36:04 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:36:04 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:36:04 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63
Oct 18 07:36:04 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:36:04 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:36:04 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740
Oct 18 07:36:04 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:36:04 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:36:04 user nova-compute[74587]: FIRMWARE:
Oct 18 07:36:04 user nova-compute[74587]: No targets found.
Oct 18 07:36:04 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:36:04 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:36:04 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b783ac6-f2f8-468f-9a23-2bbd2eb9e018]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[02591744-fe06-4eec-8383-a4ed843ddc65]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46577f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc0cc7a-cfd3-4964-adaa-555be3389d44]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fd5607-d83a-486b-8409-b4f1277cb42f]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcececc-d79c-43a7-a3b0-6d9ded31bd32]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[067c7ab4-4229-4e54-90ab-373ed114b5ba]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8785b9-8bb6-44dc-b9d9-4f0a8b1c77ff]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f392b5-7f6a-4612-8142-5d5437b06df4]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260]
Oct 18 07:36:04 user nova-compute[74587]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260] successful.
Oct 18 07:36:04 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d9050c-f3d6-4c44-ba2b-f6cf63e3070b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] <== disconnect_volume: return (330ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Start _get_guest_xml network_info=[{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a6986e6-35b6-48d4-9274-3883bb3d2940,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '7a6986e6-35b6-48d4-9274-3883bb3d2940'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8f444b88-0caf-4634-a3cd-530217a591c3', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFMTQSws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1582691-356c-4a6d-a418-eaf951033292', 'serial': 'd1582691-356c-4a6d-a418-eaf951033292'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:36:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:36:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a6986e6-35b6-48d4-9274-3883bb3d2940,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'vcpu_model' on Instance uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.objects.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Object Instance<feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599> lazy-loaded attributes: resources,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFMTQSws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:36:04 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:36:04 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:36:04 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece15a6-62cb-4192-8305-ab795047eba8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:36:04 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[725894fb-f626-4394-9a1b-33cc06f7e36f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292] added
Oct 18 07:36:04 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fc0868-c687-4b88-8d8b-c74fb8515ba6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2361895e-5806-4bae-870c-3dbb945d9569]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFMTQSws {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFMTQSws" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff354900-18d4-4a57-9848-1eaee41edfd8]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OFMTQSws'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b73fea-bbbc-4f34-a2a3-f70b791e02a8]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4455daad-0649-410a-af4e-523db1c11603]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b7f8f6-a41a-46ba-9ed3-c260577ba40c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260]
Oct 18 07:36:04 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260] successful.
Oct 18 07:36:04 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0406808c-f7f3-4d3b-9bfc-d97b32e41200]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa92563b-1431-4de0-a43f-e694d1ae5b01]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:36:04 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e39963-21e1-413d-be21-00ac4b614051]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:36:04 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFMTQSws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:05 user nova-compute[74587]: WARNING nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state active and task_state reboot_started_hard.
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:05 user nova-compute[74587]: WARNING nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state active and task_state reboot_started_hard.
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:05 user nova-compute[74587]: WARNING nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state active and task_state reboot_started_hard.
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-unplugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-unplugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:05 user nova-compute[74587]: WARNING nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-unplugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state active and task_state reboot_started_hard.
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:05 user nova-compute[74587]: WARNING nova.compute.manager [req-529053d1-d06d-4f6f-b17b-139fd97e4b44 req-b83d8c29-1cfa-4faa-a074-7bd369b35cf5 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state active and task_state reboot_started_hard.
Oct 18 07:36:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23064653965623164', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:36:05 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064653965623164', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-861854339',display_name='tempest-TestMinimumBasicScenario-server-861854339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-861854339',id=41,image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESO/HS+ngbf9m2R4QevHaLg9eF5LtfqQ/LJiD+Pa2pv6GjsOL27HsCrgWpTrae7xY7SYx9GbA91Xb21TM8prj4ufDJJfXX5LaXtsbKnImomtXI4oBhTWmoqDMrfvcUBJQ==',key_name='tempest-TestMinimumBasicScenario-1418151160',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e35a447ffe7c47b0963dc60edd4b926a',ramdisk_id='',reservation_id='r-7exmo5di',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-795187138',owner_user_name='tempest-TestMinimumBasicScenario-795187138-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:36:03Z,user_data=None,user_id='51902e137d224e428fba578e2e535656',uuid=feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converting VIF {"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'pci_devices' on Instance uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.objects.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Object Instance<feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:36:06 user nova-compute[74587]:   <uuid>feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599</uuid>
Oct 18 07:36:06 user nova-compute[74587]:   <name>instance-00000029</name>
Oct 18 07:36:06 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:36:06 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:36:06 user nova-compute[74587]:   <metadata>
Oct 18 07:36:06 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:36:06 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:36:06 user nova-compute[74587]:       <nova:name>tempest-TestMinimumBasicScenario-server-861854339</nova:name>
Oct 18 07:36:06 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:36:04</nova:creationTime>
Oct 18 07:36:06 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:36:06 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:36:06 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:36:06 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:36:06 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:36:06 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:36:06 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:36:06 user nova-compute[74587]:       <nova:owner>
Oct 18 07:36:06 user nova-compute[74587]:         <nova:user uuid="51902e137d224e428fba578e2e535656">tempest-TestMinimumBasicScenario-795187138-project-member</nova:user>
Oct 18 07:36:06 user nova-compute[74587]:         <nova:project uuid="e35a447ffe7c47b0963dc60edd4b926a">tempest-TestMinimumBasicScenario-795187138</nova:project>
Oct 18 07:36:06 user nova-compute[74587]:       </nova:owner>
Oct 18 07:36:06 user nova-compute[74587]:       <nova:root type="image" uuid="7a6986e6-35b6-48d4-9274-3883bb3d2940"/>
Oct 18 07:36:06 user nova-compute[74587]:       <nova:ports>
Oct 18 07:36:06 user nova-compute[74587]:         <nova:port uuid="2e4c6cdf-26f0-4096-a605-7161eda14b7d">
Oct 18 07:36:06 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:36:06 user nova-compute[74587]:         </nova:port>
Oct 18 07:36:06 user nova-compute[74587]:       </nova:ports>
Oct 18 07:36:06 user nova-compute[74587]:     </nova:instance>
Oct 18 07:36:06 user nova-compute[74587]:   </metadata>
Oct 18 07:36:06 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:36:06 user nova-compute[74587]:     <system>
Oct 18 07:36:06 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:36:06 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:36:06 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:36:06 user nova-compute[74587]:       <entry name="serial">feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599</entry>
Oct 18 07:36:06 user nova-compute[74587]:       <entry name="uuid">feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599</entry>
Oct 18 07:36:06 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:36:06 user nova-compute[74587]:     </system>
Oct 18 07:36:06 user nova-compute[74587]:   </sysinfo>
Oct 18 07:36:06 user nova-compute[74587]:   <os>
Oct 18 07:36:06 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:36:06 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:36:06 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:36:06 user nova-compute[74587]:   </os>
Oct 18 07:36:06 user nova-compute[74587]:   <features>
Oct 18 07:36:06 user nova-compute[74587]:     <acpi/>
Oct 18 07:36:06 user nova-compute[74587]:     <apic/>
Oct 18 07:36:06 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:36:06 user nova-compute[74587]:   </features>
Oct 18 07:36:06 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:36:06 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:36:06 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:36:06 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:36:06 user nova-compute[74587]:   </clock>
Oct 18 07:36:06 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:36:06 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:36:06 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:36:06 user nova-compute[74587]:   </cpu>
Oct 18 07:36:06 user nova-compute[74587]:   <devices>
Oct 18 07:36:06 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:36:06 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:36:06 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk"/>
Oct 18 07:36:06 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:36:06 user nova-compute[74587]:     </disk>
Oct 18 07:36:06 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:36:06 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:36:06 user nova-compute[74587]:       <source dev="/dev/sdb"/>
Oct 18 07:36:06 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:36:06 user nova-compute[74587]:       <serial>d1582691-356c-4a6d-a418-eaf951033292</serial>
Oct 18 07:36:06 user nova-compute[74587]:     </disk>
Oct 18 07:36:06 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:36:06 user nova-compute[74587]:       <mac address="fa:16:3e:09:de:b0"/>
Oct 18 07:36:06 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:36:06 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:36:06 user nova-compute[74587]:       <target dev="tap2e4c6cdf-26"/>
Oct 18 07:36:06 user nova-compute[74587]:     </interface>
Oct 18 07:36:06 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:36:06 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/console.log" append="off"/>
Oct 18 07:36:06 user nova-compute[74587]:     </serial>
Oct 18 07:36:06 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:36:06 user nova-compute[74587]:     <video>
Oct 18 07:36:06 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:36:06 user nova-compute[74587]:     </video>
Oct 18 07:36:06 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:36:06 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:36:06 user nova-compute[74587]:     </rng>
Oct 18 07:36:06 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:36:06 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:36:06 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:36:06 user nova-compute[74587]:     </memballoon>
Oct 18 07:36:06 user nova-compute[74587]:   </devices>
Oct 18 07:36:06 user nova-compute[74587]: </domain>
Oct 18 07:36:06 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'trusted_certs' on Instance uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.objects.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Object Instance<feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Cannot resize image /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'migration_context' on Instance uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.objects.base [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Object Instance<feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-861854339',display_name='tempest-TestMinimumBasicScenario-server-861854339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-861854339',id=41,image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESO/HS+ngbf9m2R4QevHaLg9eF5LtfqQ/LJiD+Pa2pv6GjsOL27HsCrgWpTrae7xY7SYx9GbA91Xb21TM8prj4ufDJJfXX5LaXtsbKnImomtXI4oBhTWmoqDMrfvcUBJQ==',key_name='tempest-TestMinimumBasicScenario-1418151160',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='e35a447ffe7c47b0963dc60edd4b926a',ramdisk_id='',reservation_id='r-7exmo5di',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-795187138',owner_user_name='tempest-TestMinimumBasicScenario-795187138-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:36:03Z,user_data=None,user_id='51902e137d224e428fba578e2e535656',uuid=feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converting VIF {"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG os_vif [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dae6c74a-c165-56e4-860f-8410121a4c8e', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e4c6cdf-26, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e4c6cdf-26, col_values=(('qos', UUID('024b512a-20fd-4ca3-bd5d-99dc64321da6')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e4c6cdf-26, col_values=(('external_ids', {'iface-id': '2e4c6cdf-26f0-4096-a605-7161eda14b7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:de:b0', 'vm-uuid': 'feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:36:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:06 user nova-compute[74587]: INFO os_vif [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26')
Oct 18 07:36:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-c528d1b2-dfb3-4fd7-acc6-2fb6e59a211a req-ee30bd44-ccab-4a29-b297-d7520b21ae63 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c528d1b2-dfb3-4fd7-acc6-2fb6e59a211a req-ee30bd44-ccab-4a29-b297-d7520b21ae63 service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c528d1b2-dfb3-4fd7-acc6-2fb6e59a211a req-ee30bd44-ccab-4a29-b297-d7520b21ae63 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c528d1b2-dfb3-4fd7-acc6-2fb6e59a211a req-ee30bd44-ccab-4a29-b297-d7520b21ae63 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-c528d1b2-dfb3-4fd7-acc6-2fb6e59a211a req-ee30bd44-ccab-4a29-b297-d7520b21ae63 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:08 user nova-compute[74587]: WARNING nova.compute.manager [req-c528d1b2-dfb3-4fd7-acc6-2fb6e59a211a req-ee30bd44-ccab-4a29-b297-d7520b21ae63 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state active and task_state reboot_started_hard.
Oct 18 07:36:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:09 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ea414a0e-7538-4490-8b78-76b852ea4214 is timed out.
Oct 18 07:36:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Successfully detached device vdb from instance ea414a0e-7538-4490-8b78-76b852ea4214 from the live domain config.
Oct 18 07:36:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQIfHoUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:36:09 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bcb4e3-4a5b-4b7f-b31d-6c8cb6d6b918]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:36:09 user nova-compute[74587]: No targets found.
Oct 18 07:36:09 user nova-compute[74587]: iSNS:
Oct 18 07:36:09 user nova-compute[74587]: No targets found.
Oct 18 07:36:09 user nova-compute[74587]: STATIC:
Oct 18 07:36:09 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292
Oct 18 07:36:09 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:36:09 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:36:09 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63
Oct 18 07:36:09 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:36:09 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:36:09 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740
Oct 18 07:36:09 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:36:09 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:36:09 user nova-compute[74587]: FIRMWARE:
Oct 18 07:36:09 user nova-compute[74587]: No targets found.
Oct 18 07:36:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:36:09 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:36:09 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c63276-bca4-492f-92b9-8524b9414362]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cba0e5a-4db8-4b78-9e49-abb1c36659da]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:36:09 user nova-compute[74587]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)
Oct 18 07:36:09 user nova-compute[74587]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:36:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:36:09 user nova-compute[74587]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 (non-flash)
Oct 18 07:36:09 user nova-compute[74587]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:36:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4505e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63'): ({'sdd'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Removing single pathed devices sdd {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e0e783-4ed7-4124-93c6-c403aab44e9f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeb9402-88a2-4d66-a9da-100e0b27f3d0]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Flushing IO for device /dev/sdd {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbb1284-74e9-4c9c-b310-8310f09f2bac]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9d182-8437-47b4-b40f-890a809374dd]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7de2adf-504f-4ecd-bd45-79a11ca387cb]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8f4bcc-b6ae-43e2-b4f5-b93741284835]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63, portal: 172.16.0.220,3260]
Oct 18 07:36:09 user nova-compute[74587]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63, portal: 172.16.0.220,3260] successful.
Oct 18 07:36:09 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe88d9e5-574d-4705-af81-df50182a2d63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8783bfd8-5fa1-4d07-bb21-cd0bcbcb8a08]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] <== disconnect_volume: return (300ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:36:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:36:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-f5776691-f1c0-4407-9c8a-f04180962c2c req-9ab83197-0bd6-4639-8b77-e54203e860ac service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f5776691-f1c0-4407-9c8a-f04180962c2c req-9ab83197-0bd6-4639-8b77-e54203e860ac service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f5776691-f1c0-4407-9c8a-f04180962c2c req-9ab83197-0bd6-4639-8b77-e54203e860ac service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f5776691-f1c0-4407-9c8a-f04180962c2c req-9ab83197-0bd6-4639-8b77-e54203e860ac service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-f5776691-f1c0-4407-9c8a-f04180962c2c req-9ab83197-0bd6-4639-8b77-e54203e860ac service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:10 user nova-compute[74587]: WARNING nova.compute.manager [req-f5776691-f1c0-4407-9c8a-f04180962c2c req-9ab83197-0bd6-4639-8b77-e54203e860ac service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state active and task_state reboot_started_hard.
Oct 18 07:36:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:36:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Instance rebooted successfully.
Oct 18 07:36:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:36:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e7e4599e-a737-4570-8069-cfc88cff50df tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.079s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:11 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lazy-loading 'flavor' on Instance uuid ea414a0e-7538-4490-8b78-76b852ea4214 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:36:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c38d7b8b-6f2d-4d62-bda2-af27573d487a tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.463s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:36:19 user nova-compute[74587]: INFO nova.compute.claims [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Claim successful on node user
Oct 18 07:36:19 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:36:19 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:36:20 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:36:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG nova.policy [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '427c1bee6dd74c388e98bfd44ecf7061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd18e7251dc4276a18772e1cd48276f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:36:20 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Creating image(s)
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "/opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "/opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "/opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk 1073741824" returned: 0 in 0.048s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Successfully created port: e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Cannot resize image /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Ensure instance console log exists: /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Successfully updated port: e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "refresh_cache-f934d521-209a-45cf-a6d8-b1eae4dd3f6d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquired lock "refresh_cache-f934d521-209a-45cf-a6d8-b1eae4dd3f6d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-da2648f8-4fb3-440d-9e80-3a688c95dc4b req-4784a50b-478d-4d3f-8149-967ed6b81be5 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Received event network-changed-e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-da2648f8-4fb3-440d-9e80-3a688c95dc4b req-4784a50b-478d-4d3f-8149-967ed6b81be5 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Refreshing instance network info cache due to event network-changed-e41afa51-4145-4a80-a864-a981443e0aea. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-da2648f8-4fb3-440d-9e80-3a688c95dc4b req-4784a50b-478d-4d3f-8149-967ed6b81be5 service nova] Acquiring lock "refresh_cache-f934d521-209a-45cf-a6d8-b1eae4dd3f6d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.network.neutron [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Updating instance_info_cache with network_info: [{"id": "e41afa51-4145-4a80-a864-a981443e0aea", "address": "fa:16:3e:f1:f7:63", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41afa51-41", "ovs_interfaceid": "e41afa51-4145-4a80-a864-a981443e0aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Releasing lock "refresh_cache-f934d521-209a-45cf-a6d8-b1eae4dd3f6d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Instance network_info: |[{"id": "e41afa51-4145-4a80-a864-a981443e0aea", "address": "fa:16:3e:f1:f7:63", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41afa51-41", "ovs_interfaceid": "e41afa51-4145-4a80-a864-a981443e0aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-da2648f8-4fb3-440d-9e80-3a688c95dc4b req-4784a50b-478d-4d3f-8149-967ed6b81be5 service nova] Acquired lock "refresh_cache-f934d521-209a-45cf-a6d8-b1eae4dd3f6d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.network.neutron [req-da2648f8-4fb3-440d-9e80-3a688c95dc4b req-4784a50b-478d-4d3f-8149-967ed6b81be5 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Refreshing network info cache for port e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Start _get_guest_xml network_info=[{"id": "e41afa51-4145-4a80-a864-a981443e0aea", "address": "fa:16:3e:f1:f7:63", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41afa51-41", "ovs_interfaceid": "e41afa51-4145-4a80-a864-a981443e0aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:36:21 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:36:21 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-347651087',display_name='tempest-VolumesActionsTest-instance-347651087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-347651087',id=46,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbd18e7251dc4276a18772e1cd48276f',ramdisk_id='',reservation_id='r-yyma0rjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-496843029',owner_user_name='tempest-VolumesActionsTest-496843029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:36:20Z,user_data=None,user_id='427c1bee6dd74c388e98bfd44ecf7061',uuid=f934d521-209a-45cf-a6d8-b1eae4dd3f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e41afa51-4145-4a80-a864-a981443e0aea", "address": "fa:16:3e:f1:f7:63", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41afa51-41", "ovs_interfaceid": "e41afa51-4145-4a80-a864-a981443e0aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converting VIF {"id": "e41afa51-4145-4a80-a864-a981443e0aea", "address": "fa:16:3e:f1:f7:63", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41afa51-41", "ovs_interfaceid": "e41afa51-4145-4a80-a864-a981443e0aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=e41afa51-4145-4a80-a864-a981443e0aea,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41afa51-41') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.objects.instance [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lazy-loading 'pci_devices' on Instance uuid f934d521-209a-45cf-a6d8-b1eae4dd3f6d {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:36:21 user nova-compute[74587]:   <uuid>f934d521-209a-45cf-a6d8-b1eae4dd3f6d</uuid>
Oct 18 07:36:21 user nova-compute[74587]:   <name>instance-0000002e</name>
Oct 18 07:36:21 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:36:21 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:36:21 user nova-compute[74587]:   <metadata>
Oct 18 07:36:21 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:36:21 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:36:21 user nova-compute[74587]:       <nova:name>tempest-VolumesActionsTest-instance-347651087</nova:name>
Oct 18 07:36:21 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:36:21</nova:creationTime>
Oct 18 07:36:21 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:36:21 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:36:21 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:36:21 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:36:21 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:36:21 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:36:21 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:36:21 user nova-compute[74587]:       <nova:owner>
Oct 18 07:36:21 user nova-compute[74587]:         <nova:user uuid="427c1bee6dd74c388e98bfd44ecf7061">tempest-VolumesActionsTest-496843029-project-member</nova:user>
Oct 18 07:36:21 user nova-compute[74587]:         <nova:project uuid="fbd18e7251dc4276a18772e1cd48276f">tempest-VolumesActionsTest-496843029</nova:project>
Oct 18 07:36:21 user nova-compute[74587]:       </nova:owner>
Oct 18 07:36:21 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:36:21 user nova-compute[74587]:       <nova:ports>
Oct 18 07:36:21 user nova-compute[74587]:         <nova:port uuid="e41afa51-4145-4a80-a864-a981443e0aea">
Oct 18 07:36:21 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 07:36:21 user nova-compute[74587]:         </nova:port>
Oct 18 07:36:21 user nova-compute[74587]:       </nova:ports>
Oct 18 07:36:21 user nova-compute[74587]:     </nova:instance>
Oct 18 07:36:21 user nova-compute[74587]:   </metadata>
Oct 18 07:36:21 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:36:21 user nova-compute[74587]:     <system>
Oct 18 07:36:21 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:36:21 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:36:21 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:36:21 user nova-compute[74587]:       <entry name="serial">f934d521-209a-45cf-a6d8-b1eae4dd3f6d</entry>
Oct 18 07:36:21 user nova-compute[74587]:       <entry name="uuid">f934d521-209a-45cf-a6d8-b1eae4dd3f6d</entry>
Oct 18 07:36:21 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:36:21 user nova-compute[74587]:     </system>
Oct 18 07:36:21 user nova-compute[74587]:   </sysinfo>
Oct 18 07:36:21 user nova-compute[74587]:   <os>
Oct 18 07:36:21 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:36:21 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:36:21 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:36:21 user nova-compute[74587]:   </os>
Oct 18 07:36:21 user nova-compute[74587]:   <features>
Oct 18 07:36:21 user nova-compute[74587]:     <acpi/>
Oct 18 07:36:21 user nova-compute[74587]:     <apic/>
Oct 18 07:36:21 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:36:21 user nova-compute[74587]:   </features>
Oct 18 07:36:21 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:36:21 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:36:21 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:36:21 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:36:21 user nova-compute[74587]:   </clock>
Oct 18 07:36:21 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:36:21 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:36:21 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:36:21 user nova-compute[74587]:   </cpu>
Oct 18 07:36:21 user nova-compute[74587]:   <devices>
Oct 18 07:36:21 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:36:21 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:36:21 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk"/>
Oct 18 07:36:21 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:36:21 user nova-compute[74587]:     </disk>
Oct 18 07:36:21 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:36:21 user nova-compute[74587]:       <mac address="fa:16:3e:f1:f7:63"/>
Oct 18 07:36:21 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:36:21 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:36:21 user nova-compute[74587]:       <target dev="tape41afa51-41"/>
Oct 18 07:36:21 user nova-compute[74587]:     </interface>
Oct 18 07:36:21 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:36:21 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/console.log" append="off"/>
Oct 18 07:36:21 user nova-compute[74587]:     </serial>
Oct 18 07:36:21 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:36:21 user nova-compute[74587]:     <video>
Oct 18 07:36:21 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:36:21 user nova-compute[74587]:     </video>
Oct 18 07:36:21 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:36:21 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:36:21 user nova-compute[74587]:     </rng>
Oct 18 07:36:21 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:36:21 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:36:21 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:36:21 user nova-compute[74587]:     </memballoon>
Oct 18 07:36:21 user nova-compute[74587]:   </devices>
Oct 18 07:36:21 user nova-compute[74587]: </domain>
Oct 18 07:36:21 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-347651087',display_name='tempest-VolumesActionsTest-instance-347651087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-347651087',id=46,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbd18e7251dc4276a18772e1cd48276f',ramdisk_id='',reservation_id='r-yyma0rjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-496843029',owner_user_name='tempest-VolumesActionsTest-496843029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:36:20Z,user_data=None,user_id='427c1bee6dd74c388e98bfd44ecf7061',uuid=f934d521-209a-45cf-a6d8-b1eae4dd3f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e41afa51-4145-4a80-a864-a981443e0aea", "address": "fa:16:3e:f1:f7:63", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41afa51-41", "ovs_interfaceid": "e41afa51-4145-4a80-a864-a981443e0aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converting VIF {"id": "e41afa51-4145-4a80-a864-a981443e0aea", "address": "fa:16:3e:f1:f7:63", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41afa51-41", "ovs_interfaceid": "e41afa51-4145-4a80-a864-a981443e0aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=e41afa51-4145-4a80-a864-a981443e0aea,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41afa51-41') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG os_vif [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=e41afa51-4145-4a80-a864-a981443e0aea,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41afa51-41') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62d684b7-896c-59c8-9055-07d9cbd829ab', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape41afa51-41, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape41afa51-41, col_values=(('qos', UUID('45ed9fd2-e8a7-4c7d-9917-8aa9f805a2ca')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape41afa51-41, col_values=(('external_ids', {'iface-id': 'e41afa51-4145-4a80-a864-a981443e0aea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:f7:63', 'vm-uuid': 'f934d521-209a-45cf-a6d8-b1eae4dd3f6d'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:21 user nova-compute[74587]: INFO os_vif [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=e41afa51-4145-4a80-a864-a981443e0aea,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41afa51-41')
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:36:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] No VIF found with MAC fa:16:3e:f1:f7:63, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:36:22 user nova-compute[74587]: DEBUG nova.network.neutron [req-da2648f8-4fb3-440d-9e80-3a688c95dc4b req-4784a50b-478d-4d3f-8149-967ed6b81be5 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Updated VIF entry in instance network info cache for port e41afa51-4145-4a80-a864-a981443e0aea. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:36:22 user nova-compute[74587]: DEBUG nova.network.neutron [req-da2648f8-4fb3-440d-9e80-3a688c95dc4b req-4784a50b-478d-4d3f-8149-967ed6b81be5 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Updating instance_info_cache with network_info: [{"id": "e41afa51-4145-4a80-a864-a981443e0aea", "address": "fa:16:3e:f1:f7:63", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41afa51-41", "ovs_interfaceid": "e41afa51-4145-4a80-a864-a981443e0aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:36:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-da2648f8-4fb3-440d-9e80-3a688c95dc4b req-4784a50b-478d-4d3f-8149-967ed6b81be5 service nova] Releasing lock "refresh_cache-f934d521-209a-45cf-a6d8-b1eae4dd3f6d" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:36:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-b5c2c457-af77-40eb-9920-06253213db9a req-56cdcd04-c717-4e1f-9ab0-5948068f8f31 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Received event network-vif-plugged-e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5c2c457-af77-40eb-9920-06253213db9a req-56cdcd04-c717-4e1f-9ab0-5948068f8f31 service nova] Acquiring lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5c2c457-af77-40eb-9920-06253213db9a req-56cdcd04-c717-4e1f-9ab0-5948068f8f31 service nova] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b5c2c457-af77-40eb-9920-06253213db9a req-56cdcd04-c717-4e1f-9ab0-5948068f8f31 service nova] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-b5c2c457-af77-40eb-9920-06253213db9a req-56cdcd04-c717-4e1f-9ab0-5948068f8f31 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] No waiting events found dispatching network-vif-plugged-e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:23 user nova-compute[74587]: WARNING nova.compute.manager [req-b5c2c457-af77-40eb-9920-06253213db9a req-56cdcd04-c717-4e1f-9ab0-5948068f8f31 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Received unexpected event network-vif-plugged-e41afa51-4145-4a80-a864-a981443e0aea for instance with vm_state building and task_state spawning.
Oct 18 07:36:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:36:25 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Instance spawned successfully.
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:36:25 user nova-compute[74587]: INFO nova.compute.manager [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Took 5.43 seconds to spawn the instance on the hypervisor.
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d106186-c424-4b2b-8bf8-27456a89448b req-efb72d3b-22fe-4615-b165-96cf286deb99 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Received event network-vif-plugged-e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d106186-c424-4b2b-8bf8-27456a89448b req-efb72d3b-22fe-4615-b165-96cf286deb99 service nova] Acquiring lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d106186-c424-4b2b-8bf8-27456a89448b req-efb72d3b-22fe-4615-b165-96cf286deb99 service nova] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4d106186-c424-4b2b-8bf8-27456a89448b req-efb72d3b-22fe-4615-b165-96cf286deb99 service nova] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-4d106186-c424-4b2b-8bf8-27456a89448b req-efb72d3b-22fe-4615-b165-96cf286deb99 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] No waiting events found dispatching network-vif-plugged-e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:25 user nova-compute[74587]: WARNING nova.compute.manager [req-4d106186-c424-4b2b-8bf8-27456a89448b req-efb72d3b-22fe-4615-b165-96cf286deb99 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Received unexpected event network-vif-plugged-e41afa51-4145-4a80-a864-a981443e0aea for instance with vm_state building and task_state spawning.
Oct 18 07:36:25 user nova-compute[74587]: INFO nova.compute.manager [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Took 6.09 seconds to build instance.
Oct 18 07:36:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-7d85a495-e745-4c8a-b7b0-233037fc80fe tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.221s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:36:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:36:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:28 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:36:29 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-a98e6d1c-f3ba-44a2-aca8-9a1153593839 req-0419ae22-841d-4329-b3bb-f87df64b3c10 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received event network-changed-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-a98e6d1c-f3ba-44a2-aca8-9a1153593839 req-0419ae22-841d-4329-b3bb-f87df64b3c10 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Refreshing instance network info cache due to event network-changed-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a98e6d1c-f3ba-44a2-aca8-9a1153593839 req-0419ae22-841d-4329-b3bb-f87df64b3c10 service nova] Acquiring lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a98e6d1c-f3ba-44a2-aca8-9a1153593839 req-0419ae22-841d-4329-b3bb-f87df64b3c10 service nova] Acquired lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG nova.network.neutron [req-a98e6d1c-f3ba-44a2-aca8-9a1153593839 req-0419ae22-841d-4329-b3bb-f87df64b3c10 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Refreshing network info cache for port 96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:30 user nova-compute[74587]: INFO nova.compute.manager [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Terminating instance
Oct 18 07:36:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-6d51f92c-918a-45d9-a084-41dcc7a3f0cd req-7072168a-a402-4479-a771-11c1a9d2910b service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received event network-vif-unplugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6d51f92c-918a-45d9-a084-41dcc7a3f0cd req-7072168a-a402-4479-a771-11c1a9d2910b service nova] Acquiring lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6d51f92c-918a-45d9-a084-41dcc7a3f0cd req-7072168a-a402-4479-a771-11c1a9d2910b service nova] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6d51f92c-918a-45d9-a084-41dcc7a3f0cd req-7072168a-a402-4479-a771-11c1a9d2910b service nova] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-6d51f92c-918a-45d9-a084-41dcc7a3f0cd req-7072168a-a402-4479-a771-11c1a9d2910b service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] No waiting events found dispatching network-vif-unplugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-6d51f92c-918a-45d9-a084-41dcc7a3f0cd req-7072168a-a402-4479-a771-11c1a9d2910b service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received event network-vif-unplugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:31 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Instance destroyed successfully.
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.objects.instance [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lazy-loading 'resources' on Instance uuid 79f2ca30-3797-41a4-bbb2-3431bedbf8f9 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1080562966',display_name='tempest-TestVolumeBootPattern-server-1080562966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1080562966',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrD4QGeTTaMlXZ8vfsMMfK6pzduYaYdY6TtuahCvtTSdq2mzozIo9GLQClLeKc4Krkj+ygZI/TyGPqsgnJukfJMz2PgqlnAY3XlyONEXn8OLnPP3EVD58CNxJh6K+Kl2g==',key_name='tempest-TestVolumeBootPattern-1340892382',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1cfa00773ba4c5498c56b84ccb307a9',ramdisk_id='',reservation_id='r-z51x9ffu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1301266373',owner_user_name='tempest-TestVolumeBootPattern-1301266373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:31:30Z,user_data=None,user_id='d13de789e98e4ba9ad22d665ff8e4ddd',uuid=79f2ca30-3797-41a4-bbb2-3431bedbf8f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converting VIF {"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f6c3a1-09') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_vif [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f6c3a1-09') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96f6c3a1-09, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=011623ee-3c8e-472a-a8e4-4f34593d3074) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:36:31 user nova-compute[74587]: INFO os_vif [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f,network=Network(5c382050-6209-473d-bec8-dc58c3551bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f6c3a1-09')
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQHxhPso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:36:31 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[745a6e6f-6d6f-48d8-8f3a-6f5aefdf8cf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:36:31 user nova-compute[74587]: No targets found.
Oct 18 07:36:31 user nova-compute[74587]: iSNS:
Oct 18 07:36:31 user nova-compute[74587]: No targets found.
Oct 18 07:36:31 user nova-compute[74587]: STATIC:
Oct 18 07:36:31 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292
Oct 18 07:36:31 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:36:31 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:36:31 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740
Oct 18 07:36:31 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:36:31 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:36:31 user nova-compute[74587]: FIRMWARE:
Oct 18 07:36:31 user nova-compute[74587]: No targets found.
Oct 18 07:36:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:36:31 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:36:31 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3b414f-36e9-41c5-9051-6862392e40cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ecea1f-384a-42a6-889c-4e5e1d1ff1b7]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:36:31 user nova-compute[74587]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:36:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 (non-flash)
Oct 18 07:36:31 user nova-compute[74587]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:36:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4657250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740'): ({'sdc'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Removing single pathed devices sdc {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9b0c3e-c298-433d-a052-6cd1c5d75708]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca52c3-c543-451d-bd04-37c45837ed8b]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Flushing IO for device /dev/sdc {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.network.neutron [req-a98e6d1c-f3ba-44a2-aca8-9a1153593839 req-0419ae22-841d-4329-b3bb-f87df64b3c10 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updated VIF entry in instance network info cache for port 96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.network.neutron [req-a98e6d1c-f3ba-44a2-aca8-9a1153593839 req-0419ae22-841d-4329-b3bb-f87df64b3c10 service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updating instance_info_cache with network_info: [{"id": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "address": "fa:16:3e:2a:64:e5", "network": {"id": "5c382050-6209-473d-bec8-dc58c3551bca", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-714441599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1cfa00773ba4c5498c56b84ccb307a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f6c3a1-09", "ovs_interfaceid": "96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[340f73b3-19b7-4690-8a56-d956abdf7aa8]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a98e6d1c-f3ba-44a2-aca8-9a1153593839 req-0419ae22-841d-4329-b3bb-f87df64b3c10 service nova] Releasing lock "refresh_cache-79f2ca30-3797-41a4-bbb2-3431bedbf8f9" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.100s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0b8d6e-e04e-4e61-aa9e-254384ec548a]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[306a9052-9d56-4d34-9620-774e65b37677]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82d6844-f1ee-4c2e-8ecc-7a366d8b0889]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260]
Oct 18 07:36:31 user nova-compute[74587]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740, portal: 172.16.0.220,3260] successful.
Oct 18 07:36:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb77fe70-658d-4680-a2da-79b135918740 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c617cb-01b5-4c3e-8a56-d78d64c77bc6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] <== disconnect_volume: return (437ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:36:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:36:31 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Deleting instance files /opt/stack/data/nova/instances/79f2ca30-3797-41a4-bbb2-3431bedbf8f9_del
Oct 18 07:36:31 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Deletion of /opt/stack/data/nova/instances/79f2ca30-3797-41a4-bbb2-3431bedbf8f9_del complete
Oct 18 07:36:32 user nova-compute[74587]: INFO nova.compute.manager [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 18 07:36:32 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:36:32 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:36:32 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:36:32 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:36:32 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Took 0.40 seconds to deallocate network for instance.
Oct 18 07:36:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-0f35d10d-a72e-4868-92db-5917935d354b req-0faa98d0-f9b2-450e-8fc0-b0eeaf04ec7b service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received event network-vif-plugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0f35d10d-a72e-4868-92db-5917935d354b req-0faa98d0-f9b2-450e-8fc0-b0eeaf04ec7b service nova] Acquiring lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0f35d10d-a72e-4868-92db-5917935d354b req-0faa98d0-f9b2-450e-8fc0-b0eeaf04ec7b service nova] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0f35d10d-a72e-4868-92db-5917935d354b req-0faa98d0-f9b2-450e-8fc0-b0eeaf04ec7b service nova] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-0f35d10d-a72e-4868-92db-5917935d354b req-0faa98d0-f9b2-450e-8fc0-b0eeaf04ec7b service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] No waiting events found dispatching network-vif-plugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:33 user nova-compute[74587]: WARNING nova.compute.manager [req-0f35d10d-a72e-4868-92db-5917935d354b req-0faa98d0-f9b2-450e-8fc0-b0eeaf04ec7b service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received unexpected event network-vif-plugged-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f for instance with vm_state active and task_state deleting.
Oct 18 07:36:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-0f35d10d-a72e-4868-92db-5917935d354b req-0faa98d0-f9b2-450e-8fc0-b0eeaf04ec7b service nova] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Received event network-vif-deleted-96f6c3a1-09e0-46e3-beb1-c7b8dcf8be2f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:34 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:36:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:36:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:36:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:36:34 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:36:34 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updating instance_info_cache with network_info: [{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:36:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:36:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:36:36 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:36:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:39 user nova-compute[74587]: INFO nova.compute.manager [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] [instance: 79f2ca30-3797-41a4-bbb2-3431bedbf8f9] Took 6.87 seconds to detach 1 volumes for instance.
Oct 18 07:36:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:39 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:36:39 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:36:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8124MB free_disk=25.10659408569336GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.628s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.074s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:40 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Deleted allocations for instance 79f2ca30-3797-41a4-bbb2-3431bedbf8f9
Oct 18 07:36:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ea414a0e-7538-4490-8b78-76b852ea4214 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance c850cad2-d127-4a39-bf71-4ca764342164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance f934d521-209a-45cf-a6d8-b1eae4dd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2ea0a49b-c49f-4e06-b3f8-95efb2245e9f tempest-TestVolumeBootPattern-1301266373 tempest-TestVolumeBootPattern-1301266373-project-member] Lock "79f2ca30-3797-41a4-bbb2-3431bedbf8f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.498s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:36:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:41 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:36:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Acquiring lock "c850cad2-d127-4a39-bf71-4ca764342164" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "c850cad2-d127-4a39-bf71-4ca764342164" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Acquiring lock "c850cad2-d127-4a39-bf71-4ca764342164-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "c850cad2-d127-4a39-bf71-4ca764342164-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "c850cad2-d127-4a39-bf71-4ca764342164-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:45 user nova-compute[74587]: INFO nova.compute.manager [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Terminating instance
Oct 18 07:36:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-bacb383c-6cc7-48a9-81b6-3a7db389866c req-2488c431-11d6-4c9b-8981-e580a72cc2cc service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Received event network-vif-unplugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bacb383c-6cc7-48a9-81b6-3a7db389866c req-2488c431-11d6-4c9b-8981-e580a72cc2cc service nova] Acquiring lock "c850cad2-d127-4a39-bf71-4ca764342164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bacb383c-6cc7-48a9-81b6-3a7db389866c req-2488c431-11d6-4c9b-8981-e580a72cc2cc service nova] Lock "c850cad2-d127-4a39-bf71-4ca764342164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bacb383c-6cc7-48a9-81b6-3a7db389866c req-2488c431-11d6-4c9b-8981-e580a72cc2cc service nova] Lock "c850cad2-d127-4a39-bf71-4ca764342164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-bacb383c-6cc7-48a9-81b6-3a7db389866c req-2488c431-11d6-4c9b-8981-e580a72cc2cc service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] No waiting events found dispatching network-vif-unplugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:45 user nova-compute[74587]: DEBUG nova.compute.manager [req-bacb383c-6cc7-48a9-81b6-3a7db389866c req-2488c431-11d6-4c9b-8981-e580a72cc2cc service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Received event network-vif-unplugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Instance destroyed successfully.
Oct 18 07:36:46 user nova-compute[74587]: DEBUG nova.objects.instance [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lazy-loading 'resources' on Instance uuid c850cad2-d127-4a39-bf71-4ca764342164 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1286203425',display_name='tempest-VolumesNegativeTest-instance-1286203425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1286203425',id=44,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:35:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6e661fa797e4575aa4f5acd581f302b',ramdisk_id='',reservation_id='r-f857yp83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-475950850',owner_user_name='tempest-VolumesNegativeTest-475950850-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:35:03Z,user_data=None,user_id='7e3cac1f54f34a7c9e5485136df872c4',uuid=c850cad2-d127-4a39-bf71-4ca764342164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "address": "fa:16:3e:ea:ac:a8", "network": {"id": "182cffc6-c674-4641-b988-87d1b288c7ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "21b75bb9de7244cb832931a64959110d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8b91c9-75", "ovs_interfaceid": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Converting VIF {"id": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "address": "fa:16:3e:ea:ac:a8", "network": {"id": "182cffc6-c674-4641-b988-87d1b288c7ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "21b75bb9de7244cb832931a64959110d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8b91c9-75", "ovs_interfaceid": "6d8b91c9-7557-4815-8db6-8f22a41b1e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ac:a8,bridge_name='br-int',has_traffic_filtering=True,id=6d8b91c9-7557-4815-8db6-8f22a41b1e11,network=Network(182cffc6-c674-4641-b988-87d1b288c7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8b91c9-75') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG os_vif [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ac:a8,bridge_name='br-int',has_traffic_filtering=True,id=6d8b91c9-7557-4815-8db6-8f22a41b1e11,network=Network(182cffc6-c674-4641-b988-87d1b288c7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8b91c9-75') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d8b91c9-75, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56646d15-5690-42df-9d87-1d6a9e86ca59) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:46 user nova-compute[74587]: INFO os_vif [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ac:a8,bridge_name='br-int',has_traffic_filtering=True,id=6d8b91c9-7557-4815-8db6-8f22a41b1e11,network=Network(182cffc6-c674-4641-b988-87d1b288c7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8b91c9-75')
Oct 18 07:36:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Deleting instance files /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164_del
Oct 18 07:36:46 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Deletion of /opt/stack/data/nova/instances/c850cad2-d127-4a39-bf71-4ca764342164_del complete
Oct 18 07:36:46 user nova-compute[74587]: INFO nova.compute.manager [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 18 07:36:46 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: c850cad2-d127-4a39-bf71-4ca764342164] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:36:46 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Took 0.39 seconds to deallocate network for instance.
Oct 18 07:36:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:47 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:36:47 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:36:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:47 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Deleted allocations for instance c850cad2-d127-4a39-bf71-4ca764342164
Oct 18 07:36:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-9267beac-ba54-4046-8007-be106f22a8cf tempest-VolumesNegativeTest-475950850 tempest-VolumesNegativeTest-475950850-project-member] Lock "c850cad2-d127-4a39-bf71-4ca764342164" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.673s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-414db457-254c-4025-90fb-fa881b817549 req-260de509-26af-40d8-8bdf-4fcc89a40789 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Received event network-vif-plugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-414db457-254c-4025-90fb-fa881b817549 req-260de509-26af-40d8-8bdf-4fcc89a40789 service nova] Acquiring lock "c850cad2-d127-4a39-bf71-4ca764342164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-414db457-254c-4025-90fb-fa881b817549 req-260de509-26af-40d8-8bdf-4fcc89a40789 service nova] Lock "c850cad2-d127-4a39-bf71-4ca764342164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-414db457-254c-4025-90fb-fa881b817549 req-260de509-26af-40d8-8bdf-4fcc89a40789 service nova] Lock "c850cad2-d127-4a39-bf71-4ca764342164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-414db457-254c-4025-90fb-fa881b817549 req-260de509-26af-40d8-8bdf-4fcc89a40789 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] No waiting events found dispatching network-vif-plugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:36:48 user nova-compute[74587]: WARNING nova.compute.manager [req-414db457-254c-4025-90fb-fa881b817549 req-260de509-26af-40d8-8bdf-4fcc89a40789 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Received unexpected event network-vif-plugged-6d8b91c9-7557-4815-8db6-8f22a41b1e11 for instance with vm_state deleted and task_state None.
Oct 18 07:36:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-414db457-254c-4025-90fb-fa881b817549 req-260de509-26af-40d8-8bdf-4fcc89a40789 service nova] [instance: c850cad2-d127-4a39-bf71-4ca764342164] Received event network-vif-deleted-6d8b91c9-7557-4815-8db6-8f22a41b1e11 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:36:49 user nova-compute[74587]: INFO nova.compute.manager [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] instance snapshotting
Oct 18 07:36:49 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Beginning live snapshot process
Oct 18 07:36:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json -f qcow2 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json -f qcow2 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5ltr9p4u/5ea7aaf7f64f44b2a56ee596ed95e521.delta 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5ltr9p4u/5ea7aaf7f64f44b2a56ee596ed95e521.delta 1073741824" returned: 0 in 0.058s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 18 07:36:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:36:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74587) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 07:36:51 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 18 07:36:51 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:36:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5ltr9p4u/5ea7aaf7f64f44b2a56ee596ed95e521.delta /opt/stack/data/nova/instances/snapshots/tmp5ltr9p4u/5ea7aaf7f64f44b2a56ee596ed95e521 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5ltr9p4u/5ea7aaf7f64f44b2a56ee596ed95e521.delta /opt/stack/data/nova/instances/snapshots/tmp5ltr9p4u/5ea7aaf7f64f44b2a56ee596ed95e521" returned: 0 in 0.720s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:52 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Snapshot extracted, beginning image upload
Oct 18 07:36:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-c0828de2-d2b8-4b52-927c-e9131e526ddc req-2edadb55-5fc5-4766-9a35-16a0463ddb0e service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-changed-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:36:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-c0828de2-d2b8-4b52-927c-e9131e526ddc req-2edadb55-5fc5-4766-9a35-16a0463ddb0e service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Refreshing instance network info cache due to event network-changed-ffe8a058-0f56-4b23-8ea8-36915a0014a8. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:36:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c0828de2-d2b8-4b52-927c-e9131e526ddc req-2edadb55-5fc5-4766-9a35-16a0463ddb0e service nova] Acquiring lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:36:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c0828de2-d2b8-4b52-927c-e9131e526ddc req-2edadb55-5fc5-4766-9a35-16a0463ddb0e service nova] Acquired lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:36:52 user nova-compute[74587]: DEBUG nova.network.neutron [req-c0828de2-d2b8-4b52-927c-e9131e526ddc req-2edadb55-5fc5-4766-9a35-16a0463ddb0e service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Refreshing network info cache for port ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:36:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:53 user nova-compute[74587]: DEBUG nova.network.neutron [req-c0828de2-d2b8-4b52-927c-e9131e526ddc req-2edadb55-5fc5-4766-9a35-16a0463ddb0e service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updated VIF entry in instance network info cache for port ffe8a058-0f56-4b23-8ea8-36915a0014a8. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:36:53 user nova-compute[74587]: DEBUG nova.network.neutron [req-c0828de2-d2b8-4b52-927c-e9131e526ddc req-2edadb55-5fc5-4766-9a35-16a0463ddb0e service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updating instance_info_cache with network_info: [{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:36:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c0828de2-d2b8-4b52-927c-e9131e526ddc req-2edadb55-5fc5-4766-9a35-16a0463ddb0e service nova] Releasing lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:36:55 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Snapshot image upload complete
Oct 18 07:36:55 user nova-compute[74587]: INFO nova.compute.manager [None req-657ef5c2-4dd5-40ad-95b4-ee2f1f717998 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Took 5.54 seconds to snapshot the instance on the hypervisor.
Oct 18 07:36:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:36:57 user nova-compute[74587]: INFO nova.compute.claims [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Claim successful on node user
Oct 18 07:36:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:36:57 user nova-compute[74587]: DEBUG nova.network.neutron [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:36:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:36:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:36:58 user nova-compute[74587]: DEBUG nova.policy [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8520ff9b3a8141ada3e3d5634762fa1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714315c24629492e94635d69c58bfef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:36:58 user nova-compute[74587]: DEBUG nova.compute.manager [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:36:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:36:58 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Creating image(s)
Oct 18 07:36:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "/opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "/opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "/opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ad28f387dad445964a3118998ef1276550d18ad8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ad28f387dad445964a3118998ef1276550d18ad8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8.part --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG nova.virt.images [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] 9cd828c0-fd0b-4612-a3d1-f5873e427d2d was qcow2, converting to raw {{(pid=74587) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8.part /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8.converted {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG nova.network.neutron [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Successfully created port: aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG nova.objects.instance [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.176s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8.part /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8.converted" returned: 0 in 0.388s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8.converted --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:36:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:36:59 user nova-compute[74587]: INFO nova.compute.manager [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Attaching volume bc959167-a6fc-4d0c-9625-7ca252b92619 to /dev/vdb
Oct 18 07:37:00 user nova-compute[74587]: DEBUG os_brick.utils [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1271f22f-e020-4435-bc33-9a48942c1dda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8.converted --force-share --output=json" returned: 0 in 0.222s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ad28f387dad445964a3118998ef1276550d18ad8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.961s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3371a-0313-4962-aa16-3bbb5213ae6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[055861db-8940-485c-878c-e04309eb2278]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcc82e5-3dcb-4eec-8cfc-41e2cd9577eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:37:00 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[715c6c5e-ed41-4398-807f-0c0801301ae0]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG os_brick.utils [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updating existing volume attachment record: d45df2ee-98e4-44e1-8915-bc7b5ccb07a4 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Successfully updated port: aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquired lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ad28f387dad445964a3118998ef1276550d18ad8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ad28f387dad445964a3118998ef1276550d18ad8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-36d210cf-59e3-4da1-a853-85c69d91e43f req-1eb98699-2b2d-4361-b049-b1e13ee36998 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received event network-changed-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-36d210cf-59e3-4da1-a853-85c69d91e43f req-1eb98699-2b2d-4361-b049-b1e13ee36998 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Refreshing instance network info cache due to event network-changed-aa466a7f-9450-48c6-947d-52ea29bc91ed. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-36d210cf-59e3-4da1-a853-85c69d91e43f req-1eb98699-2b2d-4361-b049-b1e13ee36998 service nova] Acquiring lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8 --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8,backing_fmt=raw /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8,backing_fmt=raw /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk 1073741824" returned: 0 in 0.045s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ad28f387dad445964a3118998ef1276550d18ad8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Updating instance_info_cache with network_info: [{"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Ensure instance console log exists: /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Releasing lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Instance network_info: |[{"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-36d210cf-59e3-4da1-a853-85c69d91e43f req-1eb98699-2b2d-4361-b049-b1e13ee36998 service nova] Acquired lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.network.neutron [req-36d210cf-59e3-4da1-a853-85c69d91e43f req-1eb98699-2b2d-4361-b049-b1e13ee36998 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Refreshing network info cache for port aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Start _get_guest_xml network_info=[{"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c25a109c75e33867d271ec3b1af1d663',container_format='bare',created_at=2023-10-18T07:36:49Z,direct_url=<?>,disk_format='qcow2',id=9cd828c0-fd0b-4612-a3d1-f5873e427d2d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-991730647',owner='714315c24629492e94635d69c58bfef0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T07:36:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9cd828c0-fd0b-4612-a3d1-f5873e427d2d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:37:00 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:37:00 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c25a109c75e33867d271ec3b1af1d663',container_format='bare',created_at=2023-10-18T07:36:49Z,direct_url=<?>,disk_format='qcow2',id=9cd828c0-fd0b-4612-a3d1-f5873e427d2d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-991730647',owner='714315c24629492e94635d69c58bfef0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T07:36:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-447992038',display_name='tempest-TestStampPattern-server-447992038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-447992038',id=47,image_ref='9cd828c0-fd0b-4612-a3d1-f5873e427d2d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCxWuTJ10c+whHcAUpDfDNeTRwFlH5W1d/E8jb2I/XpDzX51kKsRG9V2bdqFirsQKd0oQnenCerfZEhS8i1Eb78bX6HxHRaCTcnTxEjfRe5Q0diM4h1ECItqYcDOFplGQ==',key_name='tempest-TestStampPattern-794720162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='714315c24629492e94635d69c58bfef0',ramdisk_id='',reservation_id='r-gxlxzykn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ea414a0e-7538-4490-8b78-76b852ea4214',image_min_disk='1',image_min_ram='0',image_owner_id='714315c24629492e94635d69c58bfef0',image_owner_project_name='tempest-TestStampPattern-145299941',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-145299941-project-member',image_user_id='8520ff9b3a8141ada3e3d5634762fa1b',network_allocated='True',owner_project_name='tempest-TestStampPattern-145299941',owner_user_name='tempest-TestStampPattern-145299941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:36:58Z,user_data=None,user_id='8520ff9b3a8141ada3e3d5634762fa1b',uuid=ced61cea-9bfd-4890-ae57-5a213fb39d13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converting VIF {"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:58:37,bridge_name='br-int',has_traffic_filtering=True,id=aa466a7f-9450-48c6-947d-52ea29bc91ed,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa466a7f-94') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lazy-loading 'pci_devices' on Instance uuid ced61cea-9bfd-4890-ae57-5a213fb39d13 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:37:00 user nova-compute[74587]:   <uuid>ced61cea-9bfd-4890-ae57-5a213fb39d13</uuid>
Oct 18 07:37:00 user nova-compute[74587]:   <name>instance-0000002f</name>
Oct 18 07:37:00 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:37:00 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:37:00 user nova-compute[74587]:   <metadata>
Oct 18 07:37:00 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:37:00 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:37:00 user nova-compute[74587]:       <nova:name>tempest-TestStampPattern-server-447992038</nova:name>
Oct 18 07:37:00 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:37:00</nova:creationTime>
Oct 18 07:37:00 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:37:00 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:37:00 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:37:00 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:37:00 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:37:00 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:37:00 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:37:00 user nova-compute[74587]:       <nova:owner>
Oct 18 07:37:00 user nova-compute[74587]:         <nova:user uuid="8520ff9b3a8141ada3e3d5634762fa1b">tempest-TestStampPattern-145299941-project-member</nova:user>
Oct 18 07:37:00 user nova-compute[74587]:         <nova:project uuid="714315c24629492e94635d69c58bfef0">tempest-TestStampPattern-145299941</nova:project>
Oct 18 07:37:00 user nova-compute[74587]:       </nova:owner>
Oct 18 07:37:00 user nova-compute[74587]:       <nova:root type="image" uuid="9cd828c0-fd0b-4612-a3d1-f5873e427d2d"/>
Oct 18 07:37:00 user nova-compute[74587]:       <nova:ports>
Oct 18 07:37:00 user nova-compute[74587]:         <nova:port uuid="aa466a7f-9450-48c6-947d-52ea29bc91ed">
Oct 18 07:37:00 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 07:37:00 user nova-compute[74587]:         </nova:port>
Oct 18 07:37:00 user nova-compute[74587]:       </nova:ports>
Oct 18 07:37:00 user nova-compute[74587]:     </nova:instance>
Oct 18 07:37:00 user nova-compute[74587]:   </metadata>
Oct 18 07:37:00 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:37:00 user nova-compute[74587]:     <system>
Oct 18 07:37:00 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:37:00 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:37:00 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:37:00 user nova-compute[74587]:       <entry name="serial">ced61cea-9bfd-4890-ae57-5a213fb39d13</entry>
Oct 18 07:37:00 user nova-compute[74587]:       <entry name="uuid">ced61cea-9bfd-4890-ae57-5a213fb39d13</entry>
Oct 18 07:37:00 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:37:00 user nova-compute[74587]:     </system>
Oct 18 07:37:00 user nova-compute[74587]:   </sysinfo>
Oct 18 07:37:00 user nova-compute[74587]:   <os>
Oct 18 07:37:00 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:37:00 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:37:00 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:37:00 user nova-compute[74587]:   </os>
Oct 18 07:37:00 user nova-compute[74587]:   <features>
Oct 18 07:37:00 user nova-compute[74587]:     <acpi/>
Oct 18 07:37:00 user nova-compute[74587]:     <apic/>
Oct 18 07:37:00 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:37:00 user nova-compute[74587]:   </features>
Oct 18 07:37:00 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:37:00 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:37:00 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:37:00 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:37:00 user nova-compute[74587]:   </clock>
Oct 18 07:37:00 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:37:00 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:37:00 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:37:00 user nova-compute[74587]:   </cpu>
Oct 18 07:37:00 user nova-compute[74587]:   <devices>
Oct 18 07:37:00 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:37:00 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:37:00 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk"/>
Oct 18 07:37:00 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:37:00 user nova-compute[74587]:     </disk>
Oct 18 07:37:00 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:37:00 user nova-compute[74587]:       <mac address="fa:16:3e:a4:58:37"/>
Oct 18 07:37:00 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:37:00 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:37:00 user nova-compute[74587]:       <target dev="tapaa466a7f-94"/>
Oct 18 07:37:00 user nova-compute[74587]:     </interface>
Oct 18 07:37:00 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:37:00 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/console.log" append="off"/>
Oct 18 07:37:00 user nova-compute[74587]:     </serial>
Oct 18 07:37:00 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:37:00 user nova-compute[74587]:     <video>
Oct 18 07:37:00 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:37:00 user nova-compute[74587]:     </video>
Oct 18 07:37:00 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:37:00 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:37:00 user nova-compute[74587]:     </rng>
Oct 18 07:37:00 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:37:00 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:37:00 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:37:00 user nova-compute[74587]:     </memballoon>
Oct 18 07:37:00 user nova-compute[74587]:   </devices>
Oct 18 07:37:00 user nova-compute[74587]: </domain>
Oct 18 07:37:00 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-447992038',display_name='tempest-TestStampPattern-server-447992038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-447992038',id=47,image_ref='9cd828c0-fd0b-4612-a3d1-f5873e427d2d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCxWuTJ10c+whHcAUpDfDNeTRwFlH5W1d/E8jb2I/XpDzX51kKsRG9V2bdqFirsQKd0oQnenCerfZEhS8i1Eb78bX6HxHRaCTcnTxEjfRe5Q0diM4h1ECItqYcDOFplGQ==',key_name='tempest-TestStampPattern-794720162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='714315c24629492e94635d69c58bfef0',ramdisk_id='',reservation_id='r-gxlxzykn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ea414a0e-7538-4490-8b78-76b852ea4214',image_min_disk='1',image_min_ram='0',image_owner_id='714315c24629492e94635d69c58bfef0',image_owner_project_name='tempest-TestStampPattern-145299941',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-145299941-project-member',image_user_id='8520ff9b3a8141ada3e3d5634762fa1b',network_allocated='True',owner_project_name='tempest-TestStampPattern-145299941',owner_user_name='tempest-TestStampPattern-145299941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:36:58Z,user_data=None,user_id='8520ff9b3a8141ada3e3d5634762fa1b',uuid=ced61cea-9bfd-4890-ae57-5a213fb39d13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converting VIF {"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:58:37,bridge_name='br-int',has_traffic_filtering=True,id=aa466a7f-9450-48c6-947d-52ea29bc91ed,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa466a7f-94') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG os_vif [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:58:37,bridge_name='br-int',has_traffic_filtering=True,id=aa466a7f-9450-48c6-947d-52ea29bc91ed,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa466a7f-94') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd21511e8-1333-5a3a-9d50-59cff755fd9c', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa466a7f-94, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa466a7f-94, col_values=(('qos', UUID('002bc9db-6d4e-434c-9845-1e9e50e1d617')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa466a7f-94, col_values=(('external_ids', {'iface-id': 'aa466a7f-9450-48c6-947d-52ea29bc91ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:58:37', 'vm-uuid': 'ced61cea-9bfd-4890-ae57-5a213fb39d13'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:00 user nova-compute[74587]: INFO os_vif [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:58:37,bridge_name='br-int',has_traffic_filtering=True,id=aa466a7f-9450-48c6-947d-52ea29bc91ed,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa466a7f-94')
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:37:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] No VIF found with MAC fa:16:3e:a4:58:37, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:37:01 user nova-compute[74587]: DEBUG nova.network.neutron [req-36d210cf-59e3-4da1-a853-85c69d91e43f req-1eb98699-2b2d-4361-b049-b1e13ee36998 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Updated VIF entry in instance network info cache for port aa466a7f-9450-48c6-947d-52ea29bc91ed. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:37:01 user nova-compute[74587]: DEBUG nova.network.neutron [req-36d210cf-59e3-4da1-a853-85c69d91e43f req-1eb98699-2b2d-4361-b049-b1e13ee36998 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Updating instance_info_cache with network_info: [{"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:37:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-36d210cf-59e3-4da1-a853-85c69d91e43f req-1eb98699-2b2d-4361-b049-b1e13ee36998 service nova] Releasing lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:37:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-40c6c8e8-d47d-4618-85e1-37a744e198a3 req-1d75235f-3e26-41e0-b20b-a2126b0f2830 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received event network-vif-plugged-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:37:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-40c6c8e8-d47d-4618-85e1-37a744e198a3 req-1d75235f-3e26-41e0-b20b-a2126b0f2830 service nova] Acquiring lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-40c6c8e8-d47d-4618-85e1-37a744e198a3 req-1d75235f-3e26-41e0-b20b-a2126b0f2830 service nova] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-40c6c8e8-d47d-4618-85e1-37a744e198a3 req-1d75235f-3e26-41e0-b20b-a2126b0f2830 service nova] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:02 user nova-compute[74587]: DEBUG nova.compute.manager [req-40c6c8e8-d47d-4618-85e1-37a744e198a3 req-1d75235f-3e26-41e0-b20b-a2126b0f2830 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] No waiting events found dispatching network-vif-plugged-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:37:02 user nova-compute[74587]: WARNING nova.compute.manager [req-40c6c8e8-d47d-4618-85e1-37a744e198a3 req-1d75235f-3e26-41e0-b20b-a2126b0f2830 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received unexpected event network-vif-plugged-aa466a7f-9450-48c6-947d-52ea29bc91ed for instance with vm_state building and task_state spawning.
Oct 18 07:37:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:37:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:37:04 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Instance spawned successfully.
Oct 18 07:37:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:37:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:37:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:37:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-7c9991da-7367-40fd-8687-86a41a118033 req-59f0b22a-dcde-4137-8cfc-38fc6e6e6d55 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received event network-vif-plugged-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:37:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7c9991da-7367-40fd-8687-86a41a118033 req-59f0b22a-dcde-4137-8cfc-38fc6e6e6d55 service nova] Acquiring lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7c9991da-7367-40fd-8687-86a41a118033 req-59f0b22a-dcde-4137-8cfc-38fc6e6e6d55 service nova] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7c9991da-7367-40fd-8687-86a41a118033 req-59f0b22a-dcde-4137-8cfc-38fc6e6e6d55 service nova] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-7c9991da-7367-40fd-8687-86a41a118033 req-59f0b22a-dcde-4137-8cfc-38fc6e6e6d55 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] No waiting events found dispatching network-vif-plugged-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:37:04 user nova-compute[74587]: WARNING nova.compute.manager [req-7c9991da-7367-40fd-8687-86a41a118033 req-59f0b22a-dcde-4137-8cfc-38fc6e6e6d55 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received unexpected event network-vif-plugged-aa466a7f-9450-48c6-947d-52ea29bc91ed for instance with vm_state building and task_state spawning.
Oct 18 07:37:04 user nova-compute[74587]: INFO nova.compute.manager [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Took 6.34 seconds to spawn the instance on the hypervisor.
Oct 18 07:37:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:37:04 user nova-compute[74587]: INFO nova.compute.manager [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Took 7.05 seconds to build instance.
Oct 18 07:37:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87f8c65c-3102-401b-8112-bf22fc646c0d tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.201s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:37:09 user nova-compute[74587]: INFO nova.compute.claims [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Claim successful on node user
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:37:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.policy [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '623d2be80c4c4d71acf62880b712b376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afab563ad8cb49e58767661bbe79ffd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:37:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Creating image(s)
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "/opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "/opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "/opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:09 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk 1073741824" returned: 0 in 0.053s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Successfully created port: f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.225s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Cannot resize image /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Ensure instance console log exists: /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Successfully updated port: f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "refresh_cache-a26b93ab-8894-4ba2-8da8-d13ec4cd5337" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquired lock "refresh_cache-a26b93ab-8894-4ba2-8da8-d13ec4cd5337" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-2069b0b9-0268-4a7c-8277-b5e63eec1db3 req-3bb9eeae-3175-4b7f-b70e-fceccb21eaa7 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received event network-changed-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-2069b0b9-0268-4a7c-8277-b5e63eec1db3 req-3bb9eeae-3175-4b7f-b70e-fceccb21eaa7 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Refreshing instance network info cache due to event network-changed-f4dd0af1-9659-4652-8a70-373a61463c64. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2069b0b9-0268-4a7c-8277-b5e63eec1db3 req-3bb9eeae-3175-4b7f-b70e-fceccb21eaa7 service nova] Acquiring lock "refresh_cache-a26b93ab-8894-4ba2-8da8-d13ec4cd5337" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Updating instance_info_cache with network_info: [{"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Releasing lock "refresh_cache-a26b93ab-8894-4ba2-8da8-d13ec4cd5337" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Instance network_info: |[{"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2069b0b9-0268-4a7c-8277-b5e63eec1db3 req-3bb9eeae-3175-4b7f-b70e-fceccb21eaa7 service nova] Acquired lock "refresh_cache-a26b93ab-8894-4ba2-8da8-d13ec4cd5337" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.neutron [req-2069b0b9-0268-4a7c-8277-b5e63eec1db3 req-3bb9eeae-3175-4b7f-b70e-fceccb21eaa7 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Refreshing network info cache for port f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Start _get_guest_xml network_info=[{"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:37:11 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:37:11 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:37:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-675055037',display_name='tempest-VolumesSnapshotTestJSON-instance-675055037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-675055037',id=48,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw2l4dtvsmTZTwZHB3uMUJCSfmKH/3uJ1PDn91b0AbZt7u4/WKCCJxhMZc+28ln5UVBKl5gXuXL9ckQmXEKNmy/uPrYTUyRtSJAysGl5kIJnOtnXCuWBGHbn6uNJCf+QA==',key_name='tempest-keypair-2080343123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afab563ad8cb49e58767661bbe79ffd3',ramdisk_id='',reservation_id='r-n01modum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1818933927',owner_user_name='tempest-VolumesSnapshotTestJSON-1818933927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623d2be80c4c4d71acf62880b712b376',uuid=a26b93ab-8894-4ba2-8da8-d13ec4cd5337,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converting VIF {"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:36:0a,bridge_name='br-int',has_traffic_filtering=True,id=f4dd0af1-9659-4652-8a70-373a61463c64,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dd0af1-96') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.objects.instance [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lazy-loading 'pci_devices' on Instance uuid a26b93ab-8894-4ba2-8da8-d13ec4cd5337 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:37:11 user nova-compute[74587]:   <uuid>a26b93ab-8894-4ba2-8da8-d13ec4cd5337</uuid>
Oct 18 07:37:11 user nova-compute[74587]:   <name>instance-00000030</name>
Oct 18 07:37:11 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:37:11 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:37:11 user nova-compute[74587]:   <metadata>
Oct 18 07:37:11 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:37:11 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:37:11 user nova-compute[74587]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-675055037</nova:name>
Oct 18 07:37:11 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:37:11</nova:creationTime>
Oct 18 07:37:11 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:37:11 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:37:11 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:37:11 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:37:11 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:37:11 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:37:11 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:37:11 user nova-compute[74587]:       <nova:owner>
Oct 18 07:37:11 user nova-compute[74587]:         <nova:user uuid="623d2be80c4c4d71acf62880b712b376">tempest-VolumesSnapshotTestJSON-1818933927-project-member</nova:user>
Oct 18 07:37:11 user nova-compute[74587]:         <nova:project uuid="afab563ad8cb49e58767661bbe79ffd3">tempest-VolumesSnapshotTestJSON-1818933927</nova:project>
Oct 18 07:37:11 user nova-compute[74587]:       </nova:owner>
Oct 18 07:37:11 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:37:11 user nova-compute[74587]:       <nova:ports>
Oct 18 07:37:11 user nova-compute[74587]:         <nova:port uuid="f4dd0af1-9659-4652-8a70-373a61463c64">
Oct 18 07:37:11 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 07:37:11 user nova-compute[74587]:         </nova:port>
Oct 18 07:37:11 user nova-compute[74587]:       </nova:ports>
Oct 18 07:37:11 user nova-compute[74587]:     </nova:instance>
Oct 18 07:37:11 user nova-compute[74587]:   </metadata>
Oct 18 07:37:11 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:37:11 user nova-compute[74587]:     <system>
Oct 18 07:37:11 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:37:11 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:37:11 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:37:11 user nova-compute[74587]:       <entry name="serial">a26b93ab-8894-4ba2-8da8-d13ec4cd5337</entry>
Oct 18 07:37:11 user nova-compute[74587]:       <entry name="uuid">a26b93ab-8894-4ba2-8da8-d13ec4cd5337</entry>
Oct 18 07:37:11 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:37:11 user nova-compute[74587]:     </system>
Oct 18 07:37:11 user nova-compute[74587]:   </sysinfo>
Oct 18 07:37:11 user nova-compute[74587]:   <os>
Oct 18 07:37:11 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:37:11 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:37:11 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:37:11 user nova-compute[74587]:   </os>
Oct 18 07:37:11 user nova-compute[74587]:   <features>
Oct 18 07:37:11 user nova-compute[74587]:     <acpi/>
Oct 18 07:37:11 user nova-compute[74587]:     <apic/>
Oct 18 07:37:11 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:37:11 user nova-compute[74587]:   </features>
Oct 18 07:37:11 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:37:11 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:37:11 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:37:11 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:37:11 user nova-compute[74587]:   </clock>
Oct 18 07:37:11 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:37:11 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:37:11 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:37:11 user nova-compute[74587]:   </cpu>
Oct 18 07:37:11 user nova-compute[74587]:   <devices>
Oct 18 07:37:11 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:37:11 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:37:11 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk"/>
Oct 18 07:37:11 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:37:11 user nova-compute[74587]:     </disk>
Oct 18 07:37:11 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:37:11 user nova-compute[74587]:       <mac address="fa:16:3e:c5:36:0a"/>
Oct 18 07:37:11 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:37:11 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:37:11 user nova-compute[74587]:       <target dev="tapf4dd0af1-96"/>
Oct 18 07:37:11 user nova-compute[74587]:     </interface>
Oct 18 07:37:11 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:37:11 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/console.log" append="off"/>
Oct 18 07:37:11 user nova-compute[74587]:     </serial>
Oct 18 07:37:11 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:37:11 user nova-compute[74587]:     <video>
Oct 18 07:37:11 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:37:11 user nova-compute[74587]:     </video>
Oct 18 07:37:11 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:37:11 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:37:11 user nova-compute[74587]:     </rng>
Oct 18 07:37:11 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:37:11 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:37:11 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:37:11 user nova-compute[74587]:     </memballoon>
Oct 18 07:37:11 user nova-compute[74587]:   </devices>
Oct 18 07:37:11 user nova-compute[74587]: </domain>
Oct 18 07:37:11 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:37:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-675055037',display_name='tempest-VolumesSnapshotTestJSON-instance-675055037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-675055037',id=48,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw2l4dtvsmTZTwZHB3uMUJCSfmKH/3uJ1PDn91b0AbZt7u4/WKCCJxhMZc+28ln5UVBKl5gXuXL9ckQmXEKNmy/uPrYTUyRtSJAysGl5kIJnOtnXCuWBGHbn6uNJCf+QA==',key_name='tempest-keypair-2080343123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afab563ad8cb49e58767661bbe79ffd3',ramdisk_id='',reservation_id='r-n01modum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1818933927',owner_user_name='tempest-VolumesSnapshotTestJSON-1818933927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623d2be80c4c4d71acf62880b712b376',uuid=a26b93ab-8894-4ba2-8da8-d13ec4cd5337,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converting VIF {"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:36:0a,bridge_name='br-int',has_traffic_filtering=True,id=f4dd0af1-9659-4652-8a70-373a61463c64,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dd0af1-96') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG os_vif [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:36:0a,bridge_name='br-int',has_traffic_filtering=True,id=f4dd0af1-9659-4652-8a70-373a61463c64,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dd0af1-96') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49557acd-159e-5521-bcb7-5ff7cae488f3', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4dd0af1-96, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4dd0af1-96, col_values=(('qos', UUID('7f510e1f-0cf0-4ea5-8697-bd2dc552f4e3')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4dd0af1-96, col_values=(('external_ids', {'iface-id': 'f4dd0af1-9659-4652-8a70-373a61463c64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:36:0a', 'vm-uuid': 'a26b93ab-8894-4ba2-8da8-d13ec4cd5337'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:11 user nova-compute[74587]: INFO os_vif [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:36:0a,bridge_name='br-int',has_traffic_filtering=True,id=f4dd0af1-9659-4652-8a70-373a61463c64,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dd0af1-96')
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] No VIF found with MAC fa:16:3e:c5:36:0a, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.neutron [req-2069b0b9-0268-4a7c-8277-b5e63eec1db3 req-3bb9eeae-3175-4b7f-b70e-fceccb21eaa7 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Updated VIF entry in instance network info cache for port f4dd0af1-9659-4652-8a70-373a61463c64. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG nova.network.neutron [req-2069b0b9-0268-4a7c-8277-b5e63eec1db3 req-3bb9eeae-3175-4b7f-b70e-fceccb21eaa7 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Updating instance_info_cache with network_info: [{"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:37:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2069b0b9-0268-4a7c-8277-b5e63eec1db3 req-3bb9eeae-3175-4b7f-b70e-fceccb21eaa7 service nova] Releasing lock "refresh_cache-a26b93ab-8894-4ba2-8da8-d13ec4cd5337" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-8e553aaa-bf13-49d5-ab4e-9a2de113cf9b req-f7f282a2-b6fc-426a-b663-443646bb0a01 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received event network-vif-plugged-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8e553aaa-bf13-49d5-ab4e-9a2de113cf9b req-f7f282a2-b6fc-426a-b663-443646bb0a01 service nova] Acquiring lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8e553aaa-bf13-49d5-ab4e-9a2de113cf9b req-f7f282a2-b6fc-426a-b663-443646bb0a01 service nova] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-8e553aaa-bf13-49d5-ab4e-9a2de113cf9b req-f7f282a2-b6fc-426a-b663-443646bb0a01 service nova] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG nova.compute.manager [req-8e553aaa-bf13-49d5-ab4e-9a2de113cf9b req-f7f282a2-b6fc-426a-b663-443646bb0a01 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] No waiting events found dispatching network-vif-plugged-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:37:13 user nova-compute[74587]: WARNING nova.compute.manager [req-8e553aaa-bf13-49d5-ab4e-9a2de113cf9b req-f7f282a2-b6fc-426a-b663-443646bb0a01 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received unexpected event network-vif-plugged-f4dd0af1-9659-4652-8a70-373a61463c64 for instance with vm_state building and task_state spawning.
Oct 18 07:37:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:37:15 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Instance spawned successfully.
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-89e3ae0d-72c1-49d4-8fc7-a47c70e86379 req-97f75f3d-ef40-4a3b-8c79-3329c5cfb0db service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received event network-vif-plugged-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89e3ae0d-72c1-49d4-8fc7-a47c70e86379 req-97f75f3d-ef40-4a3b-8c79-3329c5cfb0db service nova] Acquiring lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89e3ae0d-72c1-49d4-8fc7-a47c70e86379 req-97f75f3d-ef40-4a3b-8c79-3329c5cfb0db service nova] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-89e3ae0d-72c1-49d4-8fc7-a47c70e86379 req-97f75f3d-ef40-4a3b-8c79-3329c5cfb0db service nova] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.compute.manager [req-89e3ae0d-72c1-49d4-8fc7-a47c70e86379 req-97f75f3d-ef40-4a3b-8c79-3329c5cfb0db service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] No waiting events found dispatching network-vif-plugged-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:37:15 user nova-compute[74587]: WARNING nova.compute.manager [req-89e3ae0d-72c1-49d4-8fc7-a47c70e86379 req-97f75f3d-ef40-4a3b-8c79-3329c5cfb0db service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received unexpected event network-vif-plugged-f4dd0af1-9659-4652-8a70-373a61463c64 for instance with vm_state building and task_state spawning.
Oct 18 07:37:15 user nova-compute[74587]: INFO nova.compute.manager [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Took 5.70 seconds to spawn the instance on the hypervisor.
Oct 18 07:37:15 user nova-compute[74587]: DEBUG nova.compute.manager [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:37:15 user nova-compute[74587]: INFO nova.compute.manager [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Took 6.37 seconds to build instance.
Oct 18 07:37:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-de4756ad-9f94-499d-83da-6170ae3800bb tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.549s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btNTJicx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:37:17 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:37:17 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:37:17 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cb1c3c-82ec-414e-a22b-88c37c25482e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:37:17 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a3421b-27f8-46f6-9e72-8fa265b1d436]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619] added
Oct 18 07:37:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed505d62-e936-456e-aec3-cc331abbdaa6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[25988a70-c92f-4f1f-ba4d-e9b391bb5c3e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btNTJicx {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btNTJicx" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ba6ec3-4c03-465a-8b1e-2c0f86c45eaa]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'btNTJicx'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fa1226-cc0a-4b7e-ba6e-b29b99f7cb77]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a94985-10e7-42c6-b49d-9e4b864437e3]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:37:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:37:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d3e631-76b2-42cc-a8e8-6f5a6e7ef49e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260]
Oct 18 07:37:17 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260] successful.
Oct 18 07:37:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[25db748e-c3bb-4308-ae6f-8cb7ed463aa6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2a86cc-2909-4650-a8e8-49871267f57e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:37:17 user nova-compute[74587]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:37:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:37:17 user nova-compute[74587]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:37:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f386524c-aff8-44b8-9e38-426e38cf9b9d]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:37:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btNTJicx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:37:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:37:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23066623336393366', 'path': '/dev/sdc'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:37:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066623336393366', 'path': '/dev/sdc'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:37:18 user nova-compute[74587]: DEBUG nova.objects.instance [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:37:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:37:18 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:37:18 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:37:18 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:37:18 user nova-compute[74587]:   <serial>bc959167-a6fc-4d0c-9625-7ca252b92619</serial>
Oct 18 07:37:18 user nova-compute[74587]: </disk>
Oct 18 07:37:18 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:37:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:37:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:37:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No VIF found with MAC fa:16:3e:40:13:f8, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:37:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-87ff0d24-2b6d-4322-bcda-8461f09e1bb5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.640s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1a377189-62f8-464c-9c5e-77cddd300619 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1a377189-62f8-464c-9c5e-77cddd300619 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1a377189-62f8-464c-9c5e-77cddd300619 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:37:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1a377189-62f8-464c-9c5e-77cddd300619 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74587) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 18 07:37:20 user nova-compute[74587]: DEBUG nova.objects.instance [None req-1a377189-62f8-464c-9c5e-77cddd300619 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:37:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-634191ef-02e9-4ab8-a947-419b62509840 req-921ab6f7-4577-42a3-bfbe-04a2e0e2d44a service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-unplugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:37:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-634191ef-02e9-4ab8-a947-419b62509840 req-921ab6f7-4577-42a3-bfbe-04a2e0e2d44a service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-634191ef-02e9-4ab8-a947-419b62509840 req-921ab6f7-4577-42a3-bfbe-04a2e0e2d44a service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-634191ef-02e9-4ab8-a947-419b62509840 req-921ab6f7-4577-42a3-bfbe-04a2e0e2d44a service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-634191ef-02e9-4ab8-a947-419b62509840 req-921ab6f7-4577-42a3-bfbe-04a2e0e2d44a service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-unplugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:37:21 user nova-compute[74587]: WARNING nova.compute.manager [req-634191ef-02e9-4ab8-a947-419b62509840 req-921ab6f7-4577-42a3-bfbe-04a2e0e2d44a service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-unplugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state active and task_state powering-off.
Oct 18 07:37:21 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance destroyed successfully.
Oct 18 07:37:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-1a377189-62f8-464c-9c5e-77cddd300619 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:37:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1a377189-62f8-464c-9c5e-77cddd300619 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.884s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-ad791912-fb3c-4917-956d-ca86769ce248 req-cfdd42b7-18fa-485c-b859-62b9b4eb646c service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:37:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ad791912-fb3c-4917-956d-ca86769ce248 req-cfdd42b7-18fa-485c-b859-62b9b4eb646c service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ad791912-fb3c-4917-956d-ca86769ce248 req-cfdd42b7-18fa-485c-b859-62b9b4eb646c service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ad791912-fb3c-4917-956d-ca86769ce248 req-cfdd42b7-18fa-485c-b859-62b9b4eb646c service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-ad791912-fb3c-4917-956d-ca86769ce248 req-cfdd42b7-18fa-485c-b859-62b9b4eb646c service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:37:23 user nova-compute[74587]: WARNING nova.compute.manager [req-ad791912-fb3c-4917-956d-ca86769ce248 req-cfdd42b7-18fa-485c-b859-62b9b4eb646c service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state stopped and task_state None.
Oct 18 07:37:26 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:37:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:37:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:37:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:37:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:37:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:32 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:37:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:37:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:37:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:37:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:37:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:37:35 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:37:35 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updating instance_info_cache with network_info: [{"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:37:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:37:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:37:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:37:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:37:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:37:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8073MB free_disk=24.930957794189453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ea414a0e-7538-4490-8b78-76b852ea4214 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance f934d521-209a-45cf-a6d8-b1eae4dd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ced61cea-9bfd-4890-ae57-5a213fb39d13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a26b93ab-8894-4ba2-8da8-d13ec4cd5337 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:37:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:37:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:37:54 user nova-compute[74587]: DEBUG nova.compute.manager [req-a7da8acc-7bd5-4263-942f-5a7be0492de5 req-775bff94-bc56-4e15-b448-61fabfa45346 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-changed-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:37:54 user nova-compute[74587]: DEBUG nova.compute.manager [req-a7da8acc-7bd5-4263-942f-5a7be0492de5 req-775bff94-bc56-4e15-b448-61fabfa45346 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Refreshing instance network info cache due to event network-changed-2e4c6cdf-26f0-4096-a605-7161eda14b7d. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:37:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a7da8acc-7bd5-4263-942f-5a7be0492de5 req-775bff94-bc56-4e15-b448-61fabfa45346 service nova] Acquiring lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:37:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a7da8acc-7bd5-4263-942f-5a7be0492de5 req-775bff94-bc56-4e15-b448-61fabfa45346 service nova] Acquired lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:37:54 user nova-compute[74587]: DEBUG nova.network.neutron [req-a7da8acc-7bd5-4263-942f-5a7be0492de5 req-775bff94-bc56-4e15-b448-61fabfa45346 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Refreshing network info cache for port 2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:37:55 user nova-compute[74587]: DEBUG nova.network.neutron [req-a7da8acc-7bd5-4263-942f-5a7be0492de5 req-775bff94-bc56-4e15-b448-61fabfa45346 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updated VIF entry in instance network info cache for port 2e4c6cdf-26f0-4096-a605-7161eda14b7d. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:37:55 user nova-compute[74587]: DEBUG nova.network.neutron [req-a7da8acc-7bd5-4263-942f-5a7be0492de5 req-775bff94-bc56-4e15-b448-61fabfa45346 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updating instance_info_cache with network_info: [{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:37:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a7da8acc-7bd5-4263-942f-5a7be0492de5 req-775bff94-bc56-4e15-b448-61fabfa45346 service nova] Releasing lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:37:56 user nova-compute[74587]: INFO nova.compute.manager [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Detaching volume d1582691-356c-4a6d-a418-eaf951033292
Oct 18 07:37:56 user nova-compute[74587]: INFO nova.virt.block_device [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Attempting to driver detach volume d1582691-356c-4a6d-a418-eaf951033292 from mountpoint /dev/vdb
Oct 18 07:37:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Attempting to detach device vdb from instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:37:56 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:37:56 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:37:56 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:37:56 user nova-compute[74587]:   <serial>d1582691-356c-4a6d-a418-eaf951033292</serial>
Oct 18 07:37:56 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 07:37:56 user nova-compute[74587]: </disk>
Oct 18 07:37:56 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:37:56 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Successfully detached device vdb from instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 from the persistent domain config.
Oct 18 07:37:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:37:56 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:37:56 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:37:56 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:37:56 user nova-compute[74587]:   <serial>d1582691-356c-4a6d-a418-eaf951033292</serial>
Oct 18 07:37:56 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 07:37:56 user nova-compute[74587]: </disk>
Oct 18 07:37:56 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-83e51472-cafb-4fd7-9367-9268348228e9 req-1f423946-3fbc-486a-bc20-9e4f32589abc service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-changed-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-83e51472-cafb-4fd7-9367-9268348228e9 req-1f423946-3fbc-486a-bc20-9e4f32589abc service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Refreshing instance network info cache due to event network-changed-2e4c6cdf-26f0-4096-a605-7161eda14b7d. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-83e51472-cafb-4fd7-9367-9268348228e9 req-1f423946-3fbc-486a-bc20-9e4f32589abc service nova] Acquiring lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-83e51472-cafb-4fd7-9367-9268348228e9 req-1f423946-3fbc-486a-bc20-9e4f32589abc service nova] Acquired lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG nova.network.neutron [req-83e51472-cafb-4fd7-9367-9268348228e9 req-1f423946-3fbc-486a-bc20-9e4f32589abc service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Refreshing network info cache for port 2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:37:56 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:37:57 user nova-compute[74587]: DEBUG nova.network.neutron [req-83e51472-cafb-4fd7-9367-9268348228e9 req-1f423946-3fbc-486a-bc20-9e4f32589abc service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updated VIF entry in instance network info cache for port 2e4c6cdf-26f0-4096-a605-7161eda14b7d. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:37:57 user nova-compute[74587]: DEBUG nova.network.neutron [req-83e51472-cafb-4fd7-9367-9268348228e9 req-1f423946-3fbc-486a-bc20-9e4f32589abc service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updating instance_info_cache with network_info: [{"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:37:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-83e51472-cafb-4fd7-9367-9268348228e9 req-1f423946-3fbc-486a-bc20-9e4f32589abc service nova] Releasing lock "refresh_cache-feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:37:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:38:10 user nova-compute[74587]: INFO nova.compute.manager [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Terminating instance
Oct 18 07:38:10 user nova-compute[74587]: DEBUG nova.compute.manager [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-c3230a1c-94e6-4f77-8030-a4806596d3a7 req-29fa384a-e94c-4b7b-aa38-25e4a7a71bf7 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Received event network-vif-unplugged-e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c3230a1c-94e6-4f77-8030-a4806596d3a7 req-29fa384a-e94c-4b7b-aa38-25e4a7a71bf7 service nova] Acquiring lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c3230a1c-94e6-4f77-8030-a4806596d3a7 req-29fa384a-e94c-4b7b-aa38-25e4a7a71bf7 service nova] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c3230a1c-94e6-4f77-8030-a4806596d3a7 req-29fa384a-e94c-4b7b-aa38-25e4a7a71bf7 service nova] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-c3230a1c-94e6-4f77-8030-a4806596d3a7 req-29fa384a-e94c-4b7b-aa38-25e4a7a71bf7 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] No waiting events found dispatching network-vif-unplugged-e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-c3230a1c-94e6-4f77-8030-a4806596d3a7 req-29fa384a-e94c-4b7b-aa38-25e4a7a71bf7 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Received event network-vif-unplugged-e41afa51-4145-4a80-a864-a981443e0aea for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:38:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Instance destroyed successfully.
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG nova.objects.instance [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lazy-loading 'resources' on Instance uuid f934d521-209a-45cf-a6d8-b1eae4dd3f6d {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-347651087',display_name='tempest-VolumesActionsTest-instance-347651087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-347651087',id=46,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbd18e7251dc4276a18772e1cd48276f',ramdisk_id='',reservation_id='r-yyma0rjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-496843029',owner_user_name='tempest-VolumesActionsTest-496843029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:36:26Z,user_data=None,user_id='427c1bee6dd74c388e98bfd44ecf7061',uuid=f934d521-209a-45cf-a6d8-b1eae4dd3f6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e41afa51-4145-4a80-a864-a981443e0aea", "address": "fa:16:3e:f1:f7:63", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41afa51-41", "ovs_interfaceid": "e41afa51-4145-4a80-a864-a981443e0aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converting VIF {"id": "e41afa51-4145-4a80-a864-a981443e0aea", "address": "fa:16:3e:f1:f7:63", "network": {"id": "f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522681548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd18e7251dc4276a18772e1cd48276f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41afa51-41", "ovs_interfaceid": "e41afa51-4145-4a80-a864-a981443e0aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=e41afa51-4145-4a80-a864-a981443e0aea,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41afa51-41') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG os_vif [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=e41afa51-4145-4a80-a864-a981443e0aea,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41afa51-41') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape41afa51-41, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45ed9fd2-e8a7-4c7d-9917-8aa9f805a2ca) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:10 user nova-compute[74587]: INFO os_vif [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f7:63,bridge_name='br-int',has_traffic_filtering=True,id=e41afa51-4145-4a80-a864-a981443e0aea,network=Network(f3c98bdd-ed9f-41ac-aac5-cc50aa5995ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41afa51-41')
Oct 18 07:38:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Deleting instance files /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d_del
Oct 18 07:38:10 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Deletion of /opt/stack/data/nova/instances/f934d521-209a-45cf-a6d8-b1eae4dd3f6d_del complete
Oct 18 07:38:10 user nova-compute[74587]: INFO nova.compute.manager [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 18 07:38:10 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:38:10 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:38:11 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:38:11 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Took 0.52 seconds to deallocate network for instance.
Oct 18 07:38:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:38:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:38:11 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:38:11 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:38:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:38:11 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Deleted allocations for instance f934d521-209a-45cf-a6d8-b1eae4dd3f6d
Oct 18 07:38:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-610c0c83-eaff-4e18-add1-3164d676669a tempest-VolumesActionsTest-496843029 tempest-VolumesActionsTest-496843029-project-member] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.722s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:38:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-bce42378-688a-490f-b501-72568084c548 req-e51bfba3-3e6b-41eb-aa16-d8cefdf6a8c4 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Received event network-vif-plugged-e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:38:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bce42378-688a-490f-b501-72568084c548 req-e51bfba3-3e6b-41eb-aa16-d8cefdf6a8c4 service nova] Acquiring lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:38:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bce42378-688a-490f-b501-72568084c548 req-e51bfba3-3e6b-41eb-aa16-d8cefdf6a8c4 service nova] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:38:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bce42378-688a-490f-b501-72568084c548 req-e51bfba3-3e6b-41eb-aa16-d8cefdf6a8c4 service nova] Lock "f934d521-209a-45cf-a6d8-b1eae4dd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:38:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-bce42378-688a-490f-b501-72568084c548 req-e51bfba3-3e6b-41eb-aa16-d8cefdf6a8c4 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] No waiting events found dispatching network-vif-plugged-e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:38:12 user nova-compute[74587]: WARNING nova.compute.manager [req-bce42378-688a-490f-b501-72568084c548 req-e51bfba3-3e6b-41eb-aa16-d8cefdf6a8c4 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Received unexpected event network-vif-plugged-e41afa51-4145-4a80-a864-a981443e0aea for instance with vm_state deleted and task_state None.
Oct 18 07:38:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-bce42378-688a-490f-b501-72568084c548 req-e51bfba3-3e6b-41eb-aa16-d8cefdf6a8c4 service nova] [instance: f934d521-209a-45cf-a6d8-b1eae4dd3f6d] Received event network-vif-deleted-e41afa51-4145-4a80-a864-a981443e0aea {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:38:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:16 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 is timed out.
Oct 18 07:38:16 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Successfully detached device vdb from instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 from the live domain config.
Oct 18 07:38:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFMTQSws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:38:16 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda195be-4e0b-452d-92b4-6e51e0b83444]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:38:16 user nova-compute[74587]: No targets found.
Oct 18 07:38:16 user nova-compute[74587]: iSNS:
Oct 18 07:38:16 user nova-compute[74587]: No targets found.
Oct 18 07:38:16 user nova-compute[74587]: STATIC:
Oct 18 07:38:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292
Oct 18 07:38:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:38:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:38:16 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619
Oct 18 07:38:16 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:38:16 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:38:16 user nova-compute[74587]: FIRMWARE:
Oct 18 07:38:16 user nova-compute[74587]: No targets found.
Oct 18 07:38:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:38:16 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:38:16 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd556644-61cc-4f4a-954b-cd3f96b527a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa28609-3f42-4756-88a3-d6f0af69f683]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:38:16 user nova-compute[74587]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:38:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 (non-flash)
Oct 18 07:38:16 user nova-compute[74587]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:38:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4388280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a020e5a-7224-46a8-81b3-7a94d317c1f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a1f5c-61b5-438c-9619-6222b77f4bb6]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:38:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb218b8-d213-49ff-8b77-e48f6fb7d8e5]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4cc1e0-70af-4143-ad72-5d24f8b1822d]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fec541-6b60-4904-b1ea-7a657dace371]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c84939d-b152-4b20-8629-99076e1a5ef6]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260]
Oct 18 07:38:17 user nova-compute[74587]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292, portal: 172.16.0.220,3260] successful.
Oct 18 07:38:17 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1582691-356c-4a6d-a418-eaf951033292 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6a7a62-6bff-4356-9e1c-faefd914cdca]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] <== disconnect_volume: return (287ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'flavor' on Instance uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:38:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-50cf6cb2-910f-4ee4-a171-473c47750a35 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.670s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:38:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:23 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:38:23 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:38:25 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:38:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:38:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:27 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:38:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:32 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:38:36 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:36 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:38:36 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:38:39 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:38:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:38:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:38:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:38:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:38:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:38:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8467MB free_disk=24.948131561279297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ea414a0e-7538-4490-8b78-76b852ea4214 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ced61cea-9bfd-4890-ae57-5a213fb39d13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a26b93ab-8894-4ba2-8da8-d13ec4cd5337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:38:41 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:38:42 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:38:42 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:38:42 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:38:42 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:38:42 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:38:42 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:38:42 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:38:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:38:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-bf5949c9-7c1c-4058-b2f4-2fa59fac6225 req-680f148c-46d2-45df-98de-9ffaeec34418 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received event network-changed-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG nova.compute.manager [req-bf5949c9-7c1c-4058-b2f4-2fa59fac6225 req-680f148c-46d2-45df-98de-9ffaeec34418 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Refreshing instance network info cache due to event network-changed-aa466a7f-9450-48c6-947d-52ea29bc91ed. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bf5949c9-7c1c-4058-b2f4-2fa59fac6225 req-680f148c-46d2-45df-98de-9ffaeec34418 service nova] Acquiring lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bf5949c9-7c1c-4058-b2f4-2fa59fac6225 req-680f148c-46d2-45df-98de-9ffaeec34418 service nova] Acquired lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG nova.network.neutron [req-bf5949c9-7c1c-4058-b2f4-2fa59fac6225 req-680f148c-46d2-45df-98de-9ffaeec34418 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Refreshing network info cache for port aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lazy-loading 'flavor' on Instance uuid ced61cea-9bfd-4890-ae57-5a213fb39d13 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG nova.network.neutron [req-bf5949c9-7c1c-4058-b2f4-2fa59fac6225 req-680f148c-46d2-45df-98de-9ffaeec34418 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Updated VIF entry in instance network info cache for port aa466a7f-9450-48c6-947d-52ea29bc91ed. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG nova.network.neutron [req-bf5949c9-7c1c-4058-b2f4-2fa59fac6225 req-680f148c-46d2-45df-98de-9ffaeec34418 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Updating instance_info_cache with network_info: [{"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-bf5949c9-7c1c-4058-b2f4-2fa59fac6225 req-680f148c-46d2-45df-98de-9ffaeec34418 service nova] Releasing lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:38:49 user nova-compute[74587]: INFO nova.compute.manager [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Attaching volume e13eb779-d736-444a-8ad5-dccd186f3e3a to /dev/vdb
Oct 18 07:38:49 user nova-compute[74587]: DEBUG os_brick.utils [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a48c24-7aaf-4849-a02b-38193fc86bff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[308bdaf3-6af0-41e4-958e-6069082aed81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd90524-ee67-40ed-9e20-2db6d5848645]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cd8630-d072-438c-80fd-60fabde9e14c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:38:49 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:38:49 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3e0e0a-97a9-47e2-b952-e89989b333c4]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG os_brick.utils [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:38:49 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Updating existing volume attachment record: da05e708-d856-4d09-ae84-3778c654939a {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:38:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:51 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:38:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:38:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-be192f4f-b320-467c-8a59-313b9bfaf58d req-2d84966b-d483-40d4-b194-fc27e96b4d66 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received event network-changed-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG nova.compute.manager [req-be192f4f-b320-467c-8a59-313b9bfaf58d req-2d84966b-d483-40d4-b194-fc27e96b4d66 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Refreshing instance network info cache due to event network-changed-f4dd0af1-9659-4652-8a70-373a61463c64. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-be192f4f-b320-467c-8a59-313b9bfaf58d req-2d84966b-d483-40d4-b194-fc27e96b4d66 service nova] Acquiring lock "refresh_cache-a26b93ab-8894-4ba2-8da8-d13ec4cd5337" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-be192f4f-b320-467c-8a59-313b9bfaf58d req-2d84966b-d483-40d4-b194-fc27e96b4d66 service nova] Acquired lock "refresh_cache-a26b93ab-8894-4ba2-8da8-d13ec4cd5337" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG nova.network.neutron [req-be192f4f-b320-467c-8a59-313b9bfaf58d req-2d84966b-d483-40d4-b194-fc27e96b4d66 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Refreshing network info cache for port f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lazy-loading 'flavor' on Instance uuid a26b93ab-8894-4ba2-8da8-d13ec4cd5337 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Ignoring supplied device name: /dev/vdb
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:00 user nova-compute[74587]: INFO nova.compute.manager [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Attaching volume 9504c057-d032-4cf3-a237-8179931add06 to /dev/vdb
Oct 18 07:39:00 user nova-compute[74587]: DEBUG nova.network.neutron [req-be192f4f-b320-467c-8a59-313b9bfaf58d req-2d84966b-d483-40d4-b194-fc27e96b4d66 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Updated VIF entry in instance network info cache for port f4dd0af1-9659-4652-8a70-373a61463c64. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG nova.network.neutron [req-be192f4f-b320-467c-8a59-313b9bfaf58d req-2d84966b-d483-40d4-b194-fc27e96b4d66 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Updating instance_info_cache with network_info: [{"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-be192f4f-b320-467c-8a59-313b9bfaf58d req-2d84966b-d483-40d4-b194-fc27e96b4d66 service nova] Releasing lock "refresh_cache-a26b93ab-8894-4ba2-8da8-d13ec4cd5337" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG os_brick.utils [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[60510c52-f371-4041-bcce-144e3d41bc16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[29420acd-064b-42c4-9f1e-e51e49057310]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[08143d36-5982-4ce2-8961-f3dc459c8b84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2aeda2-68b2-4ab8-a08a-2546fab001ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:39:00 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:39:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddaa6e3-0781-464f-960e-a29be16fd85c]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG os_brick.utils [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Updating existing volume attachment record: e609d7c0-ea1c-49e7-ac7f-8a9f0a2460c3 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:39:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:05 user nova-compute[74587]: INFO nova.compute.manager [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Terminating instance
Oct 18 07:39:05 user nova-compute[74587]: DEBUG nova.compute.manager [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-d8f8f71d-340f-444d-a6e2-f06a216fe9f0 req-e217c5bb-55e3-492f-b945-9cce7e716841 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-unplugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d8f8f71d-340f-444d-a6e2-f06a216fe9f0 req-e217c5bb-55e3-492f-b945-9cce7e716841 service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d8f8f71d-340f-444d-a6e2-f06a216fe9f0 req-e217c5bb-55e3-492f-b945-9cce7e716841 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d8f8f71d-340f-444d-a6e2-f06a216fe9f0 req-e217c5bb-55e3-492f-b945-9cce7e716841 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-d8f8f71d-340f-444d-a6e2-f06a216fe9f0 req-e217c5bb-55e3-492f-b945-9cce7e716841 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-unplugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:39:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-d8f8f71d-340f-444d-a6e2-f06a216fe9f0 req-e217c5bb-55e3-492f-b945-9cce7e716841 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-unplugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:39:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Instance destroyed successfully.
Oct 18 07:39:06 user nova-compute[74587]: DEBUG nova.objects.instance [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'resources' on Instance uuid feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-861854339',display_name='tempest-TestMinimumBasicScenario-server-861854339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-861854339',id=41,image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESO/HS+ngbf9m2R4QevHaLg9eF5LtfqQ/LJiD+Pa2pv6GjsOL27HsCrgWpTrae7xY7SYx9GbA91Xb21TM8prj4ufDJJfXX5LaXtsbKnImomtXI4oBhTWmoqDMrfvcUBJQ==',key_name='tempest-TestMinimumBasicScenario-1418151160',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e35a447ffe7c47b0963dc60edd4b926a',ramdisk_id='',reservation_id='r-7exmo5di',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a6986e6-35b6-48d4-9274-3883bb3d2940',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-795187138',owner_user_name='tempest-TestMinimumBasicScenario-795187138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:36:11Z,user_data=None,user_id='51902e137d224e428fba578e2e535656',uuid=feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converting VIF {"id": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "address": "fa:16:3e:09:de:b0", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4c6cdf-26", "ovs_interfaceid": "2e4c6cdf-26f0-4096-a605-7161eda14b7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG os_vif [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e4c6cdf-26, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=024b512a-20fd-4ca3-bd5d-99dc64321da6) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:06 user nova-compute[74587]: INFO os_vif [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=2e4c6cdf-26f0-4096-a605-7161eda14b7d,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4c6cdf-26')
Oct 18 07:39:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Deleting instance files /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599_del
Oct 18 07:39:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Deletion of /opt/stack/data/nova/instances/feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599_del complete
Oct 18 07:39:06 user nova-compute[74587]: INFO nova.compute.manager [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 18 07:39:06 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:39:06 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:39:06 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Took 0.50 seconds to deallocate network for instance.
Oct 18 07:39:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:07 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:39:07 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:39:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:07 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Deleted allocations for instance feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599
Oct 18 07:39:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-945dad8e-7766-4608-9e75-3a713da4b23c tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.860s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-9829aa57-fc16-4b50-af0c-d967606c94b7 req-82c71baa-f473-4bdc-8365-a1ab7373aee7 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:39:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9829aa57-fc16-4b50-af0c-d967606c94b7 req-82c71baa-f473-4bdc-8365-a1ab7373aee7 service nova] Acquiring lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9829aa57-fc16-4b50-af0c-d967606c94b7 req-82c71baa-f473-4bdc-8365-a1ab7373aee7 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9829aa57-fc16-4b50-af0c-d967606c94b7 req-82c71baa-f473-4bdc-8365-a1ab7373aee7 service nova] Lock "feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-9829aa57-fc16-4b50-af0c-d967606c94b7 req-82c71baa-f473-4bdc-8365-a1ab7373aee7 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] No waiting events found dispatching network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:39:07 user nova-compute[74587]: WARNING nova.compute.manager [req-9829aa57-fc16-4b50-af0c-d967606c94b7 req-82c71baa-f473-4bdc-8365-a1ab7373aee7 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received unexpected event network-vif-plugged-2e4c6cdf-26f0-4096-a605-7161eda14b7d for instance with vm_state deleted and task_state None.
Oct 18 07:39:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-9829aa57-fc16-4b50-af0c-d967606c94b7 req-82c71baa-f473-4bdc-8365-a1ab7373aee7 service nova] [instance: feeb6aea-e5d5-4a3f-92b6-6fbc72cf2599] Received event network-vif-deleted-2e4c6cdf-26f0-4096-a605-7161eda14b7d {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:39:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:11 user nova-compute[74587]: DEBUG nova.objects.instance [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:39:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquired lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:39:11 user nova-compute[74587]: DEBUG nova.network.neutron [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:39:11 user nova-compute[74587]: DEBUG nova.objects.instance [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'info_cache' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:11 user nova-compute[74587]: DEBUG nova.objects.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.network.neutron [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updating instance_info_cache with network_info: [{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Releasing lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:39:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance destroyed successfully.
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'resources' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.objects.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377656329',display_name='tempest-AttachVolumeTestJSON-server-1377656329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377656329',id=45,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQrfeDFSrh8ZGrOuYYha24ukykHfAOuD917olQ/lsJ8pA5vRSN5Ovrqsa2FwII8i56apAks0xnn4LKfO2tXejfQtuLNK5t/1FIWYyN9LDhAvbM+ogevAPTV3M42nN+uIw==',key_name='tempest-keypair-480105349',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-t5gx743d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=671f2969-e3dc-4696-bfae-c3507e6ca2b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_vif [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffe8a058-0f, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db83c5d1-83c2-4448-a284-7283f42b3299) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:39:12 user nova-compute[74587]: INFO os_vif [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f')
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btNTJicx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:39:12 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0737e3d3-feaa-49b1-89d2-0f03943e74c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:39:12 user nova-compute[74587]: No targets found.
Oct 18 07:39:12 user nova-compute[74587]: iSNS:
Oct 18 07:39:12 user nova-compute[74587]: No targets found.
Oct 18 07:39:12 user nova-compute[74587]: STATIC:
Oct 18 07:39:12 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619
Oct 18 07:39:12 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:39:12 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:39:12 user nova-compute[74587]: FIRMWARE:
Oct 18 07:39:12 user nova-compute[74587]: No targets found.
Oct 18 07:39:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:39:12 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:39:12 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c960ffea-a1a3-458e-9312-279e932aa376]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3264304e-d900-4886-9c9c-8ada711ee540]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46ae9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619'): ({'sdc'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Removing single pathed devices sdc {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1873c0aa-d3ca-4b90-a8eb-bb8926f3678d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7efc34a-4a53-4d79-8916-3b5fa4e55542]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flushing IO for device /dev/sdc {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f3cba7-b704-4b1f-b1f1-ba8fa5d6d01e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[397dca50-8666-4d20-84c2-9ee840c44dc1]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f13711-5e5b-4754-9959-63b58f4e763b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[837625b8-f4c4-4005-88cf-568881e92c8c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260]
Oct 18 07:39:12 user nova-compute[74587]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260] successful.
Oct 18 07:39:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa8a30-d933-4144-b1a7-4fe278e006f7]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== disconnect_volume: return (317ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Start _get_guest_xml network_info=[{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd45df2ee-98e4-44e1-8915-bc7b5ccb07a4', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btNTJicx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '671f2969-e3dc-4696-bfae-c3507e6ca2b8', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc959167-a6fc-4d0c-9625-7ca252b92619', 'serial': 'bc959167-a6fc-4d0c-9625-7ca252b92619'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'numa_topology' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.objects.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:39:12 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:39:12 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'vcpu_model' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.objects.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btNTJicx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:39:12 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:39:12 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:39:12 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f8d13e-09e6-47fe-b21f-dcdaf65a015f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:39:12 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f128a-8137-40bd-b799-5768582f484c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619] added
Oct 18 07:39:12 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e718a2e9-5302-4e65-981d-5cbfa68ecd6e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ff552b-ded9-4109-bb81-6ade33ca0f67]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btNTJicx {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btNTJicx" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cc5688-344e-43b5-8702-1c7c7bc59c2f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'btNTJicx'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3730ac6-bbc4-4518-bddd-606f15d09fe1]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:12 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f879392-a807-4507-9843-654945cb3420]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:39:13 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:39:13 user nova-compute[74587]:  {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:39:13 user nova-compute[74587]: WARNING os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 07:39:13 user nova-compute[74587]: 
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d46b56-1f91-41c0-bbe8-6376a966fb56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260]
Oct 18 07:39:13 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260] successful.
Oct 18 07:39:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed68aa08-fdff-46a1-a5e3-67cb31aaa082]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1624615-b748-4e28-91bb-65831a079d18]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39ed3bc-2b50-4927-b9f4-d9030abd807d]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:13 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btNTJicx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23066623336393366', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066623336393366', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377656329',display_name='tempest-AttachVolumeTestJSON-server-1377656329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377656329',id=45,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQrfeDFSrh8ZGrOuYYha24ukykHfAOuD917olQ/lsJ8pA5vRSN5Ovrqsa2FwII8i56apAks0xnn4LKfO2tXejfQtuLNK5t/1FIWYyN9LDhAvbM+ogevAPTV3M42nN+uIw==',key_name='tempest-keypair-480105349',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-t5gx743d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=671f2969-e3dc-4696-bfae-c3507e6ca2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.objects.instance [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'pci_devices' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.objects.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:39:14 user nova-compute[74587]:   <uuid>671f2969-e3dc-4696-bfae-c3507e6ca2b8</uuid>
Oct 18 07:39:14 user nova-compute[74587]:   <name>instance-0000002d</name>
Oct 18 07:39:14 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:39:14 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:39:14 user nova-compute[74587]:   <metadata>
Oct 18 07:39:14 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:39:14 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:39:14 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeTestJSON-server-1377656329</nova:name>
Oct 18 07:39:14 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:39:12</nova:creationTime>
Oct 18 07:39:14 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:39:14 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:39:14 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:39:14 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:39:14 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:39:14 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:39:14 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:39:14 user nova-compute[74587]:       <nova:owner>
Oct 18 07:39:14 user nova-compute[74587]:         <nova:user uuid="538ad3704d374763a318647b40cac1b6">tempest-AttachVolumeTestJSON-42078443-project-member</nova:user>
Oct 18 07:39:14 user nova-compute[74587]:         <nova:project uuid="c47608ab6414451fabf82d9e34c76a94">tempest-AttachVolumeTestJSON-42078443</nova:project>
Oct 18 07:39:14 user nova-compute[74587]:       </nova:owner>
Oct 18 07:39:14 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:39:14 user nova-compute[74587]:       <nova:ports>
Oct 18 07:39:14 user nova-compute[74587]:         <nova:port uuid="ffe8a058-0f56-4b23-8ea8-36915a0014a8">
Oct 18 07:39:14 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 07:39:14 user nova-compute[74587]:         </nova:port>
Oct 18 07:39:14 user nova-compute[74587]:       </nova:ports>
Oct 18 07:39:14 user nova-compute[74587]:     </nova:instance>
Oct 18 07:39:14 user nova-compute[74587]:   </metadata>
Oct 18 07:39:14 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:39:14 user nova-compute[74587]:     <system>
Oct 18 07:39:14 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:39:14 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:39:14 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:39:14 user nova-compute[74587]:       <entry name="serial">671f2969-e3dc-4696-bfae-c3507e6ca2b8</entry>
Oct 18 07:39:14 user nova-compute[74587]:       <entry name="uuid">671f2969-e3dc-4696-bfae-c3507e6ca2b8</entry>
Oct 18 07:39:14 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:39:14 user nova-compute[74587]:     </system>
Oct 18 07:39:14 user nova-compute[74587]:   </sysinfo>
Oct 18 07:39:14 user nova-compute[74587]:   <os>
Oct 18 07:39:14 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:39:14 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:39:14 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:39:14 user nova-compute[74587]:   </os>
Oct 18 07:39:14 user nova-compute[74587]:   <features>
Oct 18 07:39:14 user nova-compute[74587]:     <acpi/>
Oct 18 07:39:14 user nova-compute[74587]:     <apic/>
Oct 18 07:39:14 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:39:14 user nova-compute[74587]:   </features>
Oct 18 07:39:14 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:39:14 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:39:14 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:39:14 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:39:14 user nova-compute[74587]:   </clock>
Oct 18 07:39:14 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:39:14 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:39:14 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:39:14 user nova-compute[74587]:   </cpu>
Oct 18 07:39:14 user nova-compute[74587]:   <devices>
Oct 18 07:39:14 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:39:14 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:39:14 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk"/>
Oct 18 07:39:14 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:39:14 user nova-compute[74587]:     </disk>
Oct 18 07:39:14 user nova-compute[74587]:     <disk type="block" device="disk">
Oct 18 07:39:14 user nova-compute[74587]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:39:14 user nova-compute[74587]:       <source dev="/dev/sdb"/>
Oct 18 07:39:14 user nova-compute[74587]:       <target dev="vdb" bus="virtio"/>
Oct 18 07:39:14 user nova-compute[74587]:       <serial>bc959167-a6fc-4d0c-9625-7ca252b92619</serial>
Oct 18 07:39:14 user nova-compute[74587]:     </disk>
Oct 18 07:39:14 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:39:14 user nova-compute[74587]:       <mac address="fa:16:3e:40:13:f8"/>
Oct 18 07:39:14 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:39:14 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:39:14 user nova-compute[74587]:       <target dev="tapffe8a058-0f"/>
Oct 18 07:39:14 user nova-compute[74587]:     </interface>
Oct 18 07:39:14 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:39:14 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/console.log" append="off"/>
Oct 18 07:39:14 user nova-compute[74587]:     </serial>
Oct 18 07:39:14 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:39:14 user nova-compute[74587]:     <video>
Oct 18 07:39:14 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:39:14 user nova-compute[74587]:     </video>
Oct 18 07:39:14 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:39:14 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:39:14 user nova-compute[74587]:     </rng>
Oct 18 07:39:14 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:39:14 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:39:14 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:39:14 user nova-compute[74587]:     </memballoon>
Oct 18 07:39:14 user nova-compute[74587]:   </devices>
Oct 18 07:39:14 user nova-compute[74587]: </domain>
Oct 18 07:39:14 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.objects.instance [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'trusted_certs' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.objects.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:39:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Cannot resize image /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG nova.objects.instance [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'migration_context' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG nova.objects.base [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377656329',display_name='tempest-AttachVolumeTestJSON-server-1377656329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377656329',id=45,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQrfeDFSrh8ZGrOuYYha24ukykHfAOuD917olQ/lsJ8pA5vRSN5Ovrqsa2FwII8i56apAks0xnn4LKfO2tXejfQtuLNK5t/1FIWYyN9LDhAvbM+ogevAPTV3M42nN+uIw==',key_name='tempest-keypair-480105349',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-t5gx743d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=671f2969-e3dc-4696-bfae-c3507e6ca2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG os_vif [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15c00f9b-8ea7-53fa-8b99-a41ea840ca11', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffe8a058-0f, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffe8a058-0f, col_values=(('qos', UUID('976f9b6a-5b47-44d6-bc29-2aacd4543bd3')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffe8a058-0f, col_values=(('external_ids', {'iface-id': 'ffe8a058-0f56-4b23-8ea8-36915a0014a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:13:f8', 'vm-uuid': '671f2969-e3dc-4696-bfae-c3507e6ca2b8'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:39:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:15 user nova-compute[74587]: INFO os_vif [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f')
Oct 18 07:39:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfbjMvwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:39:16 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:39:16 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:39:16 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9049b40c-54b7-4884-a724-2919df8124fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:39:16 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8862acd-b9fa-413c-9ee7-c0fa50b851c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a] added
Oct 18 07:39:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-464941e1-f72c-4e68-8cf5-3b0df839ef91 req-1c9d8696-bde7-462d-9b48-0fa1b9229262 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-464941e1-f72c-4e68-8cf5-3b0df839ef91 req-1c9d8696-bde7-462d-9b48-0fa1b9229262 service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-464941e1-f72c-4e68-8cf5-3b0df839ef91 req-1c9d8696-bde7-462d-9b48-0fa1b9229262 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-464941e1-f72c-4e68-8cf5-3b0df839ef91 req-1c9d8696-bde7-462d-9b48-0fa1b9229262 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG nova.compute.manager [req-464941e1-f72c-4e68-8cf5-3b0df839ef91 req-1c9d8696-bde7-462d-9b48-0fa1b9229262 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:39:16 user nova-compute[74587]: WARNING nova.compute.manager [req-464941e1-f72c-4e68-8cf5-3b0df839ef91 req-1c9d8696-bde7-462d-9b48-0fa1b9229262 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state stopped and task_state powering-on.
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8a1046-e1db-4d5d-aff4-e2d927f3036f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6185882d-b0d4-41b6-94cb-e9de1fccf969]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LfbjMvwU {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LfbjMvwU" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f65a1c1-93b7-4bed-a050-eb15574496c0]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LfbjMvwU'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc6cfde-bf17-46eb-a42a-ce57fda05df3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeea200-f35a-4113-bc0e-203e893ed6af]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2453ea4-1d01-42de-872d-3b27fdd034c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a, portal: 172.16.0.220,3260]
Oct 18 07:39:16 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a, portal: 172.16.0.220,3260] successful.
Oct 18 07:39:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[17665042-a1dd-4dd5-9f8c-c62e9e94397b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[069c8e9c-832d-4afc-9ecb-2d945fed6da9]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:16 user nova-compute[74587]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)
Oct 18 07:39:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:16 user nova-compute[74587]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)
Oct 18 07:39:16 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:39:16 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:17 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecc5c4b-6a48-4ec4-b26e-d5ad0d7ab2d3]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:17 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:39:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfbjMvwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23665393837306139', 'path': '/dev/sdc'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665393837306139', 'path': '/dev/sdc'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lazy-loading 'flavor' on Instance uuid ced61cea-9bfd-4890-ae57-5a213fb39d13 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:39:18 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:39:18 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:39:18 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:39:18 user nova-compute[74587]:   <serial>e13eb779-d736-444a-8ad5-dccd186f3e3a</serial>
Oct 18 07:39:18 user nova-compute[74587]: </disk>
Oct 18 07:39:18 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] No VIF found with MAC fa:16:3e:a4:58:37, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXGzvKTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:39:18 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:39:18 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:39:18 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c005fa13-7149-4216-9791-04a58e9ed93f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.799s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e858efd-00f5-4500-b36c-16161fdef027]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:39:18 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[312bfbca-8d33-4381-96a3-adcd8a39e772]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06] added
Oct 18 07:39:18 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ecf09-dff4-4f13-9a8b-fbf244be615d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6519409-e682-4748-b735-6c30882041b6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PXGzvKTL {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PXGzvKTL" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[be394dfe-f724-4e53-bece-9e385058d924]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PXGzvKTL'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d60c2e-6a4c-412e-9e3b-93b0611e70a6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[73685b05-6ad7-40e6-b952-4f751b8056e8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:18 user nova-compute[74587]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)
Oct 18 07:39:18 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:18 user nova-compute[74587]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)
Oct 18 07:39:18 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.compute.manager [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:39:18 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance rebooted successfully.
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.compute.manager [None req-43b0a1d0-045b-4f1e-9c82-c30f828ca3ad tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[04539836-0e5a-489f-8033-1aab7c10034d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06, portal: 172.16.0.220,3260]
Oct 18 07:39:18 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06, portal: 172.16.0.220,3260] successful.
Oct 18 07:39:18 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.compute.manager [req-fa50ce48-6f32-4e37-8850-d4130c37590d req-b5f5cc78-96dd-447a-b761-73d242f27879 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fa50ce48-6f32-4e37-8850-d4130c37590d req-b5f5cc78-96dd-447a-b761-73d242f27879 service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fa50ce48-6f32-4e37-8850-d4130c37590d req-b5f5cc78-96dd-447a-b761-73d242f27879 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fa50ce48-6f32-4e37-8850-d4130c37590d req-b5f5cc78-96dd-447a-b761-73d242f27879 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG nova.compute.manager [req-fa50ce48-6f32-4e37-8850-d4130c37590d req-b5f5cc78-96dd-447a-b761-73d242f27879 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:39:18 user nova-compute[74587]: WARNING nova.compute.manager [req-fa50ce48-6f32-4e37-8850-d4130c37590d req-b5f5cc78-96dd-447a-b761-73d242f27879 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state stopped and task_state powering-on.
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c98ac8-b659-41fe-95af-1f3ee001f4db]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b878c-583d-4e2f-a92b-8976a14697a2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:18 user nova-compute[74587]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)
Oct 18 07:39:18 user nova-compute[74587]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 (non-flash)
Oct 18 07:39:18 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:18 user nova-compute[74587]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)
Oct 18 07:39:18 user nova-compute[74587]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 (non-flash)
Oct 18 07:39:18 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[429da3e6-6f3c-43cc-89e7-1557883b3bd5]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:39:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXGzvKTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:39:19 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:39:19 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26132366261323033', 'path': '/dev/sdd'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:39:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132366261323033', 'path': '/dev/sdd'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:39:19 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lazy-loading 'flavor' on Instance uuid a26b93ab-8894-4ba2-8da8-d13ec4cd5337 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:19 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:39:19 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:39:19 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:39:19 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:39:19 user nova-compute[74587]:   <serial>9504c057-d032-4cf3-a237-8179931add06</serial>
Oct 18 07:39:19 user nova-compute[74587]: </disk>
Oct 18 07:39:19 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:39:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:39:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:39:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] No VIF found with MAC fa:16:3e:c5:36:0a, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:39:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0ecfb89a-f107-49b0-804d-350ac74ea952 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.084s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:20 user nova-compute[74587]: INFO nova.compute.manager [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Detaching volume e13eb779-d736-444a-8ad5-dccd186f3e3a
Oct 18 07:39:20 user nova-compute[74587]: INFO nova.virt.block_device [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Attempting to driver detach volume e13eb779-d736-444a-8ad5-dccd186f3e3a from mountpoint /dev/vdb
Oct 18 07:39:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Attempting to detach device vdb from instance ced61cea-9bfd-4890-ae57-5a213fb39d13 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:39:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:39:20 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:39:20 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:39:20 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:39:20 user nova-compute[74587]:   <serial>e13eb779-d736-444a-8ad5-dccd186f3e3a</serial>
Oct 18 07:39:20 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:39:20 user nova-compute[74587]: </disk>
Oct 18 07:39:20 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:39:20 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Successfully detached device vdb from instance ced61cea-9bfd-4890-ae57-5a213fb39d13 from the persistent domain config.
Oct 18 07:39:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ced61cea-9bfd-4890-ae57-5a213fb39d13 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:39:20 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:39:20 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:39:20 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:39:20 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:39:20 user nova-compute[74587]:   <serial>e13eb779-d736-444a-8ad5-dccd186f3e3a</serial>
Oct 18 07:39:20 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:39:20 user nova-compute[74587]: </disk>
Oct 18 07:39:20 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:39:21 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ced61cea-9bfd-4890-ae57-5a213fb39d13 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:39:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:29 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:39:29 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:39:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:39:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:39:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:39:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:39:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:39:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:39:34 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:39:34 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:39:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:37 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:39:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:39:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:39:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:39:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:39:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:39:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:39:38 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid ea414a0e-7538-4490-8b78-76b852ea4214 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:38 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updating instance_info_cache with network_info: [{"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:39:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:39:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:39:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:39:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ced61cea-9bfd-4890-ae57-5a213fb39d13 is timed out.
Oct 18 07:39:41 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Successfully detached device vdb from instance ced61cea-9bfd-4890-ae57-5a213fb39d13 from the live domain config.
Oct 18 07:39:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:39:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8394MB free_disk=24.97292709350586GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfbjMvwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:39:41 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd5f0f-af75-4a9f-8195-78131139df0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:39:41 user nova-compute[74587]: No targets found.
Oct 18 07:39:41 user nova-compute[74587]: iSNS:
Oct 18 07:39:41 user nova-compute[74587]: No targets found.
Oct 18 07:39:41 user nova-compute[74587]: STATIC:
Oct 18 07:39:41 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a
Oct 18 07:39:41 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:39:41 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:39:41 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06
Oct 18 07:39:41 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:39:41 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:39:41 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619
Oct 18 07:39:41 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:39:41 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:39:41 user nova-compute[74587]: FIRMWARE:
Oct 18 07:39:41 user nova-compute[74587]: No targets found.
Oct 18 07:39:41 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:39:41 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:39:41 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1c4e80-122d-4382-970a-e3be847dcb62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a62df6-ed3c-4707-92e1-da31b09272b6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:41 user nova-compute[74587]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)
Oct 18 07:39:41 user nova-compute[74587]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 (non-flash)
Oct 18 07:39:41 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:39:41 user nova-compute[74587]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a (non-flash)
Oct 18 07:39:41 user nova-compute[74587]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 (non-flash)
Oct 18 07:39:41 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46aeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a'): ({'sdc'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Removing single pathed devices sdc {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ea414a0e-7538-4490-8b78-76b852ea4214 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ced61cea-9bfd-4890-ae57-5a213fb39d13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a26b93ab-8894-4ba2-8da8-d13ec4cd5337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[17283554-fb95-4347-897e-2bea616cd38d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf79a1f3-20c2-4ce4-a76d-a27764a09559]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Flushing IO for device /dev/sdc {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e800f63-269c-4eb2-b759-49700846877b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cdc561-4711-4560-b00e-605bc4ba316c]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.057s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e551c6-f6b4-4c49-b631-5aaf5371971b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff4a01a-5620-4e64-93d1-86bf8a32c0ed]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a, portal: 172.16.0.220,3260]
Oct 18 07:39:41 user nova-compute[74587]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a, portal: 172.16.0.220,3260] successful.
Oct 18 07:39:41 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13eb779-d736-444a-8ad5-dccd186f3e3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[751b53b5-14bd-43e5-b354-f98fa5c4fe3f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] <== disconnect_volume: return (347ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:39:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:39:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:39:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:39:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:48 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lazy-loading 'flavor' on Instance uuid ced61cea-9bfd-4890-ae57-5a213fb39d13 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:39:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f40a2d66-0ef1-4d11-b7a6-12a8a4363bda tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.684s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:39:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:39:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:59 user nova-compute[74587]: DEBUG nova.compute.manager [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:39:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:39:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:39:59 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:39:59 user nova-compute[74587]: INFO nova.compute.claims [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Claim successful on node user
Oct 18 07:40:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:40:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:40:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG nova.policy [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51902e137d224e428fba578e2e535656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35a447ffe7c47b0963dc60edd4b926a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:40:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Creating image(s)
Oct 18 07:40:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "/opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "/opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "/opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "ff98de6cadfdcbbdfa1c025bfdd84349affcb175" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "ff98de6cadfdcbbdfa1c025bfdd84349affcb175" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175.part --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Successfully created port: ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175.part --force-share --output=json" returned: 0 in 0.167s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG nova.virt.images [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] 00da3f3a-a4cf-47c1-9d01-6e2f43c879d4 was qcow2, converting to raw {{(pid=74587) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG nova.privsep.utils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74587) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175.part /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175.converted {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175.part /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175.converted" returned: 0 in 0.409s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175.converted --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "ff98de6cadfdcbbdfa1c025bfdd84349affcb175" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.244s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG nova.network.neutron [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Successfully updated port: ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquired lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG nova.network.neutron [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG nova.network.neutron [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-68bacaf4-02ab-445b-b94e-73fd52cc8ade req-324371fb-aaf3-41ce-aabc-2cc5ccd71c2a service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-changed-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG nova.compute.manager [req-68bacaf4-02ab-445b-b94e-73fd52cc8ade req-324371fb-aaf3-41ce-aabc-2cc5ccd71c2a service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Refreshing instance network info cache due to event network-changed-ea118f0d-278c-4ab8-bf73-830b41c50424. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-68bacaf4-02ab-445b-b94e-73fd52cc8ade req-324371fb-aaf3-41ce-aabc-2cc5ccd71c2a service nova] Acquiring lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175 --force-share --output=json" returned: 0 in 0.237s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "ff98de6cadfdcbbdfa1c025bfdd84349affcb175" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "ff98de6cadfdcbbdfa1c025bfdd84349affcb175" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:01 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating instance_info_cache with network_info: [{"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175 --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175,backing_fmt=raw /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Releasing lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Instance network_info: |[{"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-68bacaf4-02ab-445b-b94e-73fd52cc8ade req-324371fb-aaf3-41ce-aabc-2cc5ccd71c2a service nova] Acquired lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-68bacaf4-02ab-445b-b94e-73fd52cc8ade req-324371fb-aaf3-41ce-aabc-2cc5ccd71c2a service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Refreshing network info cache for port ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175,backing_fmt=raw /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk 1073741824" returned: 0 in 0.051s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "ff98de6cadfdcbbdfa1c025bfdd84349affcb175" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175 --force-share --output=json" returned: 0 in 0.169s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Cannot resize image /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Ensure instance console log exists: /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Start _get_guest_xml network_info=[{"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:39:57Z,direct_url=<?>,disk_format='qcow2',id=00da3f3a-a4cf-47c1-9d01-6e2f43c879d4,min_disk=0,min_ram=0,name='tempest-scenario-img--1328816299',owner='e35a447ffe7c47b0963dc60edd4b926a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:39:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '00da3f3a-a4cf-47c1-9d01-6e2f43c879d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:40:02 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:40:02 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:39:57Z,direct_url=<?>,disk_format='qcow2',id=00da3f3a-a4cf-47c1-9d01-6e2f43c879d4,min_disk=0,min_ram=0,name='tempest-scenario-img--1328816299',owner='e35a447ffe7c47b0963dc60edd4b926a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:39:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1423278931',display_name='tempest-TestMinimumBasicScenario-server-1423278931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1423278931',id=49,image_ref='00da3f3a-a4cf-47c1-9d01-6e2f43c879d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGYAr05TWDrqBXeCnHiF5SAzboy2ATS10PMndop2dgTQ2B3dhCvmL1UtO6fvOKvtC5UohCrEilyGxD+GmoplY9pBKGaanqvLGCa9Pm0JOg67Fg5LghHTEV4z6c9fqYwww==',key_name='tempest-TestMinimumBasicScenario-17858413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35a447ffe7c47b0963dc60edd4b926a',ramdisk_id='',reservation_id='r-uhw0arf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='00da3f3a-a4cf-47c1-9d01-6e2f43c879d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-795187138',owner_user_name='tempest-TestMinimumBasicScenario-795187138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:40:00Z,user_data=None,user_id='51902e137d224e428fba578e2e535656',uuid=8556baa1-eb26-4fc0-bd76-9424e84e7a83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converting VIF {"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:eb:77,bridge_name='br-int',has_traffic_filtering=True,id=ea118f0d-278c-4ab8-bf73-830b41c50424,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea118f0d-27') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.objects.instance [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'pci_devices' on Instance uuid 8556baa1-eb26-4fc0-bd76-9424e84e7a83 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:40:02 user nova-compute[74587]:   <uuid>8556baa1-eb26-4fc0-bd76-9424e84e7a83</uuid>
Oct 18 07:40:02 user nova-compute[74587]:   <name>instance-00000031</name>
Oct 18 07:40:02 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:40:02 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:40:02 user nova-compute[74587]:   <metadata>
Oct 18 07:40:02 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:40:02 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:40:02 user nova-compute[74587]:       <nova:name>tempest-TestMinimumBasicScenario-server-1423278931</nova:name>
Oct 18 07:40:02 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:40:02</nova:creationTime>
Oct 18 07:40:02 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:40:02 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:40:02 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:40:02 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:40:02 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:40:02 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:40:02 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:40:02 user nova-compute[74587]:       <nova:owner>
Oct 18 07:40:02 user nova-compute[74587]:         <nova:user uuid="51902e137d224e428fba578e2e535656">tempest-TestMinimumBasicScenario-795187138-project-member</nova:user>
Oct 18 07:40:02 user nova-compute[74587]:         <nova:project uuid="e35a447ffe7c47b0963dc60edd4b926a">tempest-TestMinimumBasicScenario-795187138</nova:project>
Oct 18 07:40:02 user nova-compute[74587]:       </nova:owner>
Oct 18 07:40:02 user nova-compute[74587]:       <nova:root type="image" uuid="00da3f3a-a4cf-47c1-9d01-6e2f43c879d4"/>
Oct 18 07:40:02 user nova-compute[74587]:       <nova:ports>
Oct 18 07:40:02 user nova-compute[74587]:         <nova:port uuid="ea118f0d-278c-4ab8-bf73-830b41c50424">
Oct 18 07:40:02 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 07:40:02 user nova-compute[74587]:         </nova:port>
Oct 18 07:40:02 user nova-compute[74587]:       </nova:ports>
Oct 18 07:40:02 user nova-compute[74587]:     </nova:instance>
Oct 18 07:40:02 user nova-compute[74587]:   </metadata>
Oct 18 07:40:02 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:40:02 user nova-compute[74587]:     <system>
Oct 18 07:40:02 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:40:02 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:40:02 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:40:02 user nova-compute[74587]:       <entry name="serial">8556baa1-eb26-4fc0-bd76-9424e84e7a83</entry>
Oct 18 07:40:02 user nova-compute[74587]:       <entry name="uuid">8556baa1-eb26-4fc0-bd76-9424e84e7a83</entry>
Oct 18 07:40:02 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:40:02 user nova-compute[74587]:     </system>
Oct 18 07:40:02 user nova-compute[74587]:   </sysinfo>
Oct 18 07:40:02 user nova-compute[74587]:   <os>
Oct 18 07:40:02 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:40:02 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:40:02 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:40:02 user nova-compute[74587]:   </os>
Oct 18 07:40:02 user nova-compute[74587]:   <features>
Oct 18 07:40:02 user nova-compute[74587]:     <acpi/>
Oct 18 07:40:02 user nova-compute[74587]:     <apic/>
Oct 18 07:40:02 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:40:02 user nova-compute[74587]:   </features>
Oct 18 07:40:02 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:40:02 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:40:02 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:40:02 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:40:02 user nova-compute[74587]:   </clock>
Oct 18 07:40:02 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:40:02 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:40:02 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:40:02 user nova-compute[74587]:   </cpu>
Oct 18 07:40:02 user nova-compute[74587]:   <devices>
Oct 18 07:40:02 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:40:02 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:40:02 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk"/>
Oct 18 07:40:02 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:40:02 user nova-compute[74587]:     </disk>
Oct 18 07:40:02 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:40:02 user nova-compute[74587]:       <mac address="fa:16:3e:0a:eb:77"/>
Oct 18 07:40:02 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:40:02 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:40:02 user nova-compute[74587]:       <target dev="tapea118f0d-27"/>
Oct 18 07:40:02 user nova-compute[74587]:     </interface>
Oct 18 07:40:02 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:40:02 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/console.log" append="off"/>
Oct 18 07:40:02 user nova-compute[74587]:     </serial>
Oct 18 07:40:02 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:40:02 user nova-compute[74587]:     <video>
Oct 18 07:40:02 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:40:02 user nova-compute[74587]:     </video>
Oct 18 07:40:02 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:40:02 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:40:02 user nova-compute[74587]:     </rng>
Oct 18 07:40:02 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:40:02 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:40:02 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:40:02 user nova-compute[74587]:     </memballoon>
Oct 18 07:40:02 user nova-compute[74587]:   </devices>
Oct 18 07:40:02 user nova-compute[74587]: </domain>
Oct 18 07:40:02 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1423278931',display_name='tempest-TestMinimumBasicScenario-server-1423278931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1423278931',id=49,image_ref='00da3f3a-a4cf-47c1-9d01-6e2f43c879d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGYAr05TWDrqBXeCnHiF5SAzboy2ATS10PMndop2dgTQ2B3dhCvmL1UtO6fvOKvtC5UohCrEilyGxD+GmoplY9pBKGaanqvLGCa9Pm0JOg67Fg5LghHTEV4z6c9fqYwww==',key_name='tempest-TestMinimumBasicScenario-17858413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35a447ffe7c47b0963dc60edd4b926a',ramdisk_id='',reservation_id='r-uhw0arf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='00da3f3a-a4cf-47c1-9d01-6e2f43c879d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-795187138',owner_user_name='tempest-TestMinimumBasicScenario-795187138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:40:00Z,user_data=None,user_id='51902e137d224e428fba578e2e535656',uuid=8556baa1-eb26-4fc0-bd76-9424e84e7a83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converting VIF {"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:eb:77,bridge_name='br-int',has_traffic_filtering=True,id=ea118f0d-278c-4ab8-bf73-830b41c50424,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea118f0d-27') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG os_vif [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:eb:77,bridge_name='br-int',has_traffic_filtering=True,id=ea118f0d-278c-4ab8-bf73-830b41c50424,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea118f0d-27') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7397f66-2c67-5a79-b8a5-79d6c31672f2', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea118f0d-27, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea118f0d-27, col_values=(('qos', UUID('7d512b73-37d4-4fce-906d-54083deea1eb')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea118f0d-27, col_values=(('external_ids', {'iface-id': 'ea118f0d-278c-4ab8-bf73-830b41c50424', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:eb:77', 'vm-uuid': '8556baa1-eb26-4fc0-bd76-9424e84e7a83'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:02 user nova-compute[74587]: INFO os_vif [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:eb:77,bridge_name='br-int',has_traffic_filtering=True,id=ea118f0d-278c-4ab8-bf73-830b41c50424,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea118f0d-27')
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-68bacaf4-02ab-445b-b94e-73fd52cc8ade req-324371fb-aaf3-41ce-aabc-2cc5ccd71c2a service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updated VIF entry in instance network info cache for port ea118f0d-278c-4ab8-bf73-830b41c50424. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.network.neutron [req-68bacaf4-02ab-445b-b94e-73fd52cc8ade req-324371fb-aaf3-41ce-aabc-2cc5ccd71c2a service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating instance_info_cache with network_info: [{"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-68bacaf4-02ab-445b-b94e-73fd52cc8ade req-324371fb-aaf3-41ce-aabc-2cc5ccd71c2a service nova] Releasing lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:40:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] No VIF found with MAC fa:16:3e:0a:eb:77, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:40:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-cd20cd32-20c2-4aef-b944-d9155708eccd req-f5b946d3-341c-4f8d-95dd-0bf6da348fc4 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:40:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cd20cd32-20c2-4aef-b944-d9155708eccd req-f5b946d3-341c-4f8d-95dd-0bf6da348fc4 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cd20cd32-20c2-4aef-b944-d9155708eccd req-f5b946d3-341c-4f8d-95dd-0bf6da348fc4 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cd20cd32-20c2-4aef-b944-d9155708eccd req-f5b946d3-341c-4f8d-95dd-0bf6da348fc4 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:04 user nova-compute[74587]: DEBUG nova.compute.manager [req-cd20cd32-20c2-4aef-b944-d9155708eccd req-f5b946d3-341c-4f8d-95dd-0bf6da348fc4 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:40:04 user nova-compute[74587]: WARNING nova.compute.manager [req-cd20cd32-20c2-4aef-b944-d9155708eccd req-f5b946d3-341c-4f8d-95dd-0bf6da348fc4 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state building and task_state spawning.
Oct 18 07:40:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:40:06 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Instance spawned successfully.
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-d6d1b15a-0b29-4ad6-81cf-63ebe5decd20 req-7693025c-a302-46d7-a35c-f9d2d84c4471 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d6d1b15a-0b29-4ad6-81cf-63ebe5decd20 req-7693025c-a302-46d7-a35c-f9d2d84c4471 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d6d1b15a-0b29-4ad6-81cf-63ebe5decd20 req-7693025c-a302-46d7-a35c-f9d2d84c4471 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-d6d1b15a-0b29-4ad6-81cf-63ebe5decd20 req-7693025c-a302-46d7-a35c-f9d2d84c4471 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.compute.manager [req-d6d1b15a-0b29-4ad6-81cf-63ebe5decd20 req-7693025c-a302-46d7-a35c-f9d2d84c4471 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:40:06 user nova-compute[74587]: WARNING nova.compute.manager [req-d6d1b15a-0b29-4ad6-81cf-63ebe5decd20 req-7693025c-a302-46d7-a35c-f9d2d84c4471 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state building and task_state spawning.
Oct 18 07:40:06 user nova-compute[74587]: INFO nova.compute.manager [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Took 6.11 seconds to spawn the instance on the hypervisor.
Oct 18 07:40:06 user nova-compute[74587]: DEBUG nova.compute.manager [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:40:06 user nova-compute[74587]: INFO nova.compute.manager [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Took 6.80 seconds to build instance.
Oct 18 07:40:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-854805ee-c576-4e75-aa44-3c615d25943e tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.095s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:09 user nova-compute[74587]: INFO nova.compute.manager [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Detaching volume 9504c057-d032-4cf3-a237-8179931add06
Oct 18 07:40:09 user nova-compute[74587]: INFO nova.virt.block_device [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Attempting to driver detach volume 9504c057-d032-4cf3-a237-8179931add06 from mountpoint /dev/vdb
Oct 18 07:40:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Attempting to detach device vdb from instance a26b93ab-8894-4ba2-8da8-d13ec4cd5337 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:40:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:40:09 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:40:09 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:40:09 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:40:09 user nova-compute[74587]:   <serial>9504c057-d032-4cf3-a237-8179931add06</serial>
Oct 18 07:40:09 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:40:09 user nova-compute[74587]: </disk>
Oct 18 07:40:09 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:40:09 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Successfully detached device vdb from instance a26b93ab-8894-4ba2-8da8-d13ec4cd5337 from the persistent domain config.
Oct 18 07:40:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a26b93ab-8894-4ba2-8da8-d13ec4cd5337 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:40:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:40:09 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:40:09 user nova-compute[74587]:   <source dev="/dev/sdd"/>
Oct 18 07:40:09 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:40:09 user nova-compute[74587]:   <serial>9504c057-d032-4cf3-a237-8179931add06</serial>
Oct 18 07:40:09 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:40:09 user nova-compute[74587]: </disk>
Oct 18 07:40:09 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:40:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:09 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a26b93ab-8894-4ba2-8da8-d13ec4cd5337 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-73b003f1-6c8a-4438-8617-e56bf0eea18d req-59a0ffbe-7f6d-4996-88c0-390bc3ea2642 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received event network-changed-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG nova.compute.manager [req-73b003f1-6c8a-4438-8617-e56bf0eea18d req-59a0ffbe-7f6d-4996-88c0-390bc3ea2642 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Refreshing instance network info cache due to event network-changed-aa466a7f-9450-48c6-947d-52ea29bc91ed. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-73b003f1-6c8a-4438-8617-e56bf0eea18d req-59a0ffbe-7f6d-4996-88c0-390bc3ea2642 service nova] Acquiring lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-73b003f1-6c8a-4438-8617-e56bf0eea18d req-59a0ffbe-7f6d-4996-88c0-390bc3ea2642 service nova] Acquired lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG nova.network.neutron [req-73b003f1-6c8a-4438-8617-e56bf0eea18d req-59a0ffbe-7f6d-4996-88c0-390bc3ea2642 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Refreshing network info cache for port aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:11 user nova-compute[74587]: INFO nova.compute.manager [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Terminating instance
Oct 18 07:40:11 user nova-compute[74587]: DEBUG nova.compute.manager [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-529f8c03-927f-4824-ae8d-e7dd09a5b669 req-dae443f3-b897-4dc4-a410-b7fbab0c6a4e service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received event network-vif-unplugged-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529f8c03-927f-4824-ae8d-e7dd09a5b669 req-dae443f3-b897-4dc4-a410-b7fbab0c6a4e service nova] Acquiring lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529f8c03-927f-4824-ae8d-e7dd09a5b669 req-dae443f3-b897-4dc4-a410-b7fbab0c6a4e service nova] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-529f8c03-927f-4824-ae8d-e7dd09a5b669 req-dae443f3-b897-4dc4-a410-b7fbab0c6a4e service nova] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-529f8c03-927f-4824-ae8d-e7dd09a5b669 req-dae443f3-b897-4dc4-a410-b7fbab0c6a4e service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] No waiting events found dispatching network-vif-unplugged-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.compute.manager [req-529f8c03-927f-4824-ae8d-e7dd09a5b669 req-dae443f3-b897-4dc4-a410-b7fbab0c6a4e service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received event network-vif-unplugged-aa466a7f-9450-48c6-947d-52ea29bc91ed for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.network.neutron [req-73b003f1-6c8a-4438-8617-e56bf0eea18d req-59a0ffbe-7f6d-4996-88c0-390bc3ea2642 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Updated VIF entry in instance network info cache for port aa466a7f-9450-48c6-947d-52ea29bc91ed. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.network.neutron [req-73b003f1-6c8a-4438-8617-e56bf0eea18d req-59a0ffbe-7f6d-4996-88c0-390bc3ea2642 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Updating instance_info_cache with network_info: [{"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-73b003f1-6c8a-4438-8617-e56bf0eea18d req-59a0ffbe-7f6d-4996-88c0-390bc3ea2642 service nova] Releasing lock "refresh_cache-ced61cea-9bfd-4890-ae57-5a213fb39d13" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:40:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Instance destroyed successfully.
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lazy-loading 'resources' on Instance uuid ced61cea-9bfd-4890-ae57-5a213fb39d13 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-447992038',display_name='tempest-TestStampPattern-server-447992038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-447992038',id=47,image_ref='9cd828c0-fd0b-4612-a3d1-f5873e427d2d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCxWuTJ10c+whHcAUpDfDNeTRwFlH5W1d/E8jb2I/XpDzX51kKsRG9V2bdqFirsQKd0oQnenCerfZEhS8i1Eb78bX6HxHRaCTcnTxEjfRe5Q0diM4h1ECItqYcDOFplGQ==',key_name='tempest-TestStampPattern-794720162',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:37:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='714315c24629492e94635d69c58bfef0',ramdisk_id='',reservation_id='r-gxlxzykn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ea414a0e-7538-4490-8b78-76b852ea4214',image_min_disk='1',image_min_ram='0',image_owner_id='714315c24629492e94635d69c58bfef0',image_owner_project_name='tempest-TestStampPattern-145299941',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-145299941-project-member',image_user_id='8520ff9b3a8141ada3e3d5634762fa1b',owner_project_name='tempest-TestStampPattern-145299941',owner_user_name='tempest-TestStampPattern-145299941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:37:05Z,user_data=None,user_id='8520ff9b3a8141ada3e3d5634762fa1b',uuid=ced61cea-9bfd-4890-ae57-5a213fb39d13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converting VIF {"id": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "address": "fa:16:3e:a4:58:37", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa466a7f-94", "ovs_interfaceid": "aa466a7f-9450-48c6-947d-52ea29bc91ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:58:37,bridge_name='br-int',has_traffic_filtering=True,id=aa466a7f-9450-48c6-947d-52ea29bc91ed,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa466a7f-94') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG os_vif [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:58:37,bridge_name='br-int',has_traffic_filtering=True,id=aa466a7f-9450-48c6-947d-52ea29bc91ed,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa466a7f-94') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa466a7f-94, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=002bc9db-6d4e-434c-9845-1e9e50e1d617) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:12 user nova-compute[74587]: INFO os_vif [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:58:37,bridge_name='br-int',has_traffic_filtering=True,id=aa466a7f-9450-48c6-947d-52ea29bc91ed,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa466a7f-94')
Oct 18 07:40:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Deleting instance files /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13_del
Oct 18 07:40:12 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Deletion of /opt/stack/data/nova/instances/ced61cea-9bfd-4890-ae57-5a213fb39d13_del complete
Oct 18 07:40:12 user nova-compute[74587]: INFO nova.compute.manager [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 18 07:40:12 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:40:12 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:40:13 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:40:13 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Took 0.44 seconds to deallocate network for instance.
Oct 18 07:40:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:13 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:40:13 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:40:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:13 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Deleted allocations for instance ced61cea-9bfd-4890-ae57-5a213fb39d13
Oct 18 07:40:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-cd747b3d-07bd-4894-b2df-f13a6cca638f tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.820s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-a02e5a34-d93a-4723-81f2-d37e0e2ac938 req-0634e084-352b-41f2-b6f1-1c6b1cb22f58 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received event network-vif-plugged-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:40:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a02e5a34-d93a-4723-81f2-d37e0e2ac938 req-0634e084-352b-41f2-b6f1-1c6b1cb22f58 service nova] Acquiring lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a02e5a34-d93a-4723-81f2-d37e0e2ac938 req-0634e084-352b-41f2-b6f1-1c6b1cb22f58 service nova] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:14 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a02e5a34-d93a-4723-81f2-d37e0e2ac938 req-0634e084-352b-41f2-b6f1-1c6b1cb22f58 service nova] Lock "ced61cea-9bfd-4890-ae57-5a213fb39d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-a02e5a34-d93a-4723-81f2-d37e0e2ac938 req-0634e084-352b-41f2-b6f1-1c6b1cb22f58 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] No waiting events found dispatching network-vif-plugged-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:40:14 user nova-compute[74587]: WARNING nova.compute.manager [req-a02e5a34-d93a-4723-81f2-d37e0e2ac938 req-0634e084-352b-41f2-b6f1-1c6b1cb22f58 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received unexpected event network-vif-plugged-aa466a7f-9450-48c6-947d-52ea29bc91ed for instance with vm_state deleted and task_state None.
Oct 18 07:40:14 user nova-compute[74587]: DEBUG nova.compute.manager [req-a02e5a34-d93a-4723-81f2-d37e0e2ac938 req-0634e084-352b-41f2-b6f1-1c6b1cb22f58 service nova] [instance: ced61cea-9bfd-4890-ae57-5a213fb39d13] Received event network-vif-deleted-aa466a7f-9450-48c6-947d-52ea29bc91ed {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:40:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:40:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:29 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a26b93ab-8894-4ba2-8da8-d13ec4cd5337 is timed out.
Oct 18 07:40:29 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Successfully detached device vdb from instance a26b93ab-8894-4ba2-8da8-d13ec4cd5337 from the live domain config.
Oct 18 07:40:29 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXGzvKTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:40:29 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[46719c4d-ce0a-4d88-ae99-01e02769c340]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:40:29 user nova-compute[74587]: No targets found.
Oct 18 07:40:29 user nova-compute[74587]: iSNS:
Oct 18 07:40:29 user nova-compute[74587]: No targets found.
Oct 18 07:40:29 user nova-compute[74587]: STATIC:
Oct 18 07:40:29 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06
Oct 18 07:40:29 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:40:29 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:40:29 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619
Oct 18 07:40:29 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:40:29 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:40:29 user nova-compute[74587]: FIRMWARE:
Oct 18 07:40:29 user nova-compute[74587]: No targets found.
Oct 18 07:40:29 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:40:29 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:40:29 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76698d7-d5bb-48f2-a8db-93c3615b9d93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e436ec-b726-4873-8aae-9af14dde0e7b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:40:29 user nova-compute[74587]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 (non-flash)
Oct 18 07:40:29 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:40:29 user nova-compute[74587]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 (non-flash)
Oct 18 07:40:29 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe45181f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06'): ({'sdd'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Removing single pathed devices sdd {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccae9d7f-3fd0-49c2-8730-2cb9a0fed7da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd32074-c33a-4570-bb6f-9debad4c8dde]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Flushing IO for device /dev/sdd {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a28e7f5-a08e-482c-be8f-ed15ce2ed109]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fedc088-cf7b-479b-a87c-0f5c9732c785]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] SCSI volumes sdd have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7bf789-1be1-4b24-b060-9a9b09568540]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:40:29 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[851bd6b5-3a88-44c8-b5e7-b58ed94d5573]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06, portal: 172.16.0.220,3260]
Oct 18 07:40:30 user nova-compute[74587]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06, portal: 172.16.0.220,3260] successful.
Oct 18 07:40:30 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0693b3-840b-4f6f-8d12-96bc6cbd5b2f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] <== disconnect_volume: return (321ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG nova.objects.instance [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lazy-loading 'flavor' on Instance uuid a26b93ab-8894-4ba2-8da8-d13ec4cd5337 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-1a3a9475-0fe6-4116-90fe-e5f767bf3465 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.779s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.652s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:30 user nova-compute[74587]: INFO nova.compute.manager [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Terminating instance
Oct 18 07:40:30 user nova-compute[74587]: DEBUG nova.compute.manager [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-cacc7949-669d-4dcf-8fce-7599bf842a7f req-444cd137-5dbe-4a43-be2e-43349dfb5e92 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received event network-vif-unplugged-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cacc7949-669d-4dcf-8fce-7599bf842a7f req-444cd137-5dbe-4a43-be2e-43349dfb5e92 service nova] Acquiring lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cacc7949-669d-4dcf-8fce-7599bf842a7f req-444cd137-5dbe-4a43-be2e-43349dfb5e92 service nova] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-cacc7949-669d-4dcf-8fce-7599bf842a7f req-444cd137-5dbe-4a43-be2e-43349dfb5e92 service nova] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-cacc7949-669d-4dcf-8fce-7599bf842a7f req-444cd137-5dbe-4a43-be2e-43349dfb5e92 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] No waiting events found dispatching network-vif-unplugged-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.compute.manager [req-cacc7949-669d-4dcf-8fce-7599bf842a7f req-444cd137-5dbe-4a43-be2e-43349dfb5e92 service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received event network-vif-unplugged-f4dd0af1-9659-4652-8a70-373a61463c64 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:40:31 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Instance destroyed successfully.
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.objects.instance [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lazy-loading 'resources' on Instance uuid a26b93ab-8894-4ba2-8da8-d13ec4cd5337 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:37:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-675055037',display_name='tempest-VolumesSnapshotTestJSON-instance-675055037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-675055037',id=48,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw2l4dtvsmTZTwZHB3uMUJCSfmKH/3uJ1PDn91b0AbZt7u4/WKCCJxhMZc+28ln5UVBKl5gXuXL9ckQmXEKNmy/uPrYTUyRtSJAysGl5kIJnOtnXCuWBGHbn6uNJCf+QA==',key_name='tempest-keypair-2080343123',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afab563ad8cb49e58767661bbe79ffd3',ramdisk_id='',reservation_id='r-n01modum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1818933927',owner_user_name='tempest-VolumesSnapshotTestJSON-1818933927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623d2be80c4c4d71acf62880b712b376',uuid=a26b93ab-8894-4ba2-8da8-d13ec4cd5337,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converting VIF {"id": "f4dd0af1-9659-4652-8a70-373a61463c64", "address": "fa:16:3e:c5:36:0a", "network": {"id": "6e044b8c-9372-4fb8-b313-7e86458b2034", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-55310581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab563ad8cb49e58767661bbe79ffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dd0af1-96", "ovs_interfaceid": "f4dd0af1-9659-4652-8a70-373a61463c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:36:0a,bridge_name='br-int',has_traffic_filtering=True,id=f4dd0af1-9659-4652-8a70-373a61463c64,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dd0af1-96') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_vif [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:36:0a,bridge_name='br-int',has_traffic_filtering=True,id=f4dd0af1-9659-4652-8a70-373a61463c64,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dd0af1-96') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4dd0af1-96, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f510e1f-0cf0-4ea5-8697-bd2dc552f4e3) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:40:31 user nova-compute[74587]: INFO os_vif [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:36:0a,bridge_name='br-int',has_traffic_filtering=True,id=f4dd0af1-9659-4652-8a70-373a61463c64,network=Network(6e044b8c-9372-4fb8-b313-7e86458b2034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dd0af1-96')
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXGzvKTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:40:31 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[68abc662-a0a6-4390-9c5d-4ea88722feb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:40:31 user nova-compute[74587]: No targets found.
Oct 18 07:40:31 user nova-compute[74587]: iSNS:
Oct 18 07:40:31 user nova-compute[74587]: No targets found.
Oct 18 07:40:31 user nova-compute[74587]: STATIC:
Oct 18 07:40:31 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619
Oct 18 07:40:31 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:40:31 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:40:31 user nova-compute[74587]: FIRMWARE:
Oct 18 07:40:31 user nova-compute[74587]: No targets found.
Oct 18 07:40:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:40:31 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:40:31 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9504c057-d032-4cf3-a237-8179931add06', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9f7ec0-ab6d-4b54-9679-f8d1473793db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7648b44-5f4f-4ced-a5e7-440c26cb7004]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:40:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:40:31 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4519360>, {}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Disconnecting from: [] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] <== disconnect_volume: return (69ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:40:31 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Deleting instance files /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337_del
Oct 18 07:40:31 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Deletion of /opt/stack/data/nova/instances/a26b93ab-8894-4ba2-8da8-d13ec4cd5337_del complete
Oct 18 07:40:31 user nova-compute[74587]: INFO nova.compute.manager [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 18 07:40:31 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:40:31 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:40:32 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:40:32 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Took 0.79 seconds to deallocate network for instance.
Oct 18 07:40:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-80941772-7929-4396-b08a-46b40c56c3d6 req-4a29b11d-12e5-4c07-ab97-42d3b426e15b service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received event network-vif-deleted-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:40:32 user nova-compute[74587]: WARNING nova.volume.cinder [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Attachment e609d7c0-ea1c-49e7-ac7f-8a9f0a2460c3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e609d7c0-ea1c-49e7-ac7f-8a9f0a2460c3. (HTTP 404) (Request-ID: req-5b72c652-ea90-4118-8fd3-77c0a0acb465)
Oct 18 07:40:32 user nova-compute[74587]: INFO nova.compute.manager [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Took 0.03 seconds to detach 1 volumes for instance.
Oct 18 07:40:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:32 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:32 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:40:32 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:40:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:32 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Deleted allocations for instance a26b93ab-8894-4ba2-8da8-d13ec4cd5337
Oct 18 07:40:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-5b2f9cd4-d71d-42a8-8bb4-1cfdb0caee69 tempest-VolumesSnapshotTestJSON-1818933927 tempest-VolumesSnapshotTestJSON-1818933927-project-member] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.151s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-6328555a-6c25-4f63-9129-fe9d27317975 req-a6f7a414-b2c2-457e-84d3-4dab44bb3d2e service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received event network-vif-plugged-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:40:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6328555a-6c25-4f63-9129-fe9d27317975 req-a6f7a414-b2c2-457e-84d3-4dab44bb3d2e service nova] Acquiring lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6328555a-6c25-4f63-9129-fe9d27317975 req-a6f7a414-b2c2-457e-84d3-4dab44bb3d2e service nova] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6328555a-6c25-4f63-9129-fe9d27317975 req-a6f7a414-b2c2-457e-84d3-4dab44bb3d2e service nova] Lock "a26b93ab-8894-4ba2-8da8-d13ec4cd5337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:33 user nova-compute[74587]: DEBUG nova.compute.manager [req-6328555a-6c25-4f63-9129-fe9d27317975 req-a6f7a414-b2c2-457e-84d3-4dab44bb3d2e service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] No waiting events found dispatching network-vif-plugged-f4dd0af1-9659-4652-8a70-373a61463c64 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:40:33 user nova-compute[74587]: WARNING nova.compute.manager [req-6328555a-6c25-4f63-9129-fe9d27317975 req-a6f7a414-b2c2-457e-84d3-4dab44bb3d2e service nova] [instance: a26b93ab-8894-4ba2-8da8-d13ec4cd5337] Received unexpected event network-vif-plugged-f4dd0af1-9659-4652-8a70-373a61463c64 for instance with vm_state deleted and task_state None.
Oct 18 07:40:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:40:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:40:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:40:36 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:40:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:40:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:40:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:40:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:40:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:40:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8496MB free_disk=24.94245147705078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:40:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:40:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:40:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance ea414a0e-7538-4490-8b78-76b852ea4214 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:40:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:40:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:40:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:40:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:40:41 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:40:41 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:40:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:40:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:40:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:40:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:40:42 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:40:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:40:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:40:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:40:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updating instance_info_cache with network_info: [{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:40:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:40:42 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:40:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:40:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:40:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:02 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:03 user nova-compute[74587]: INFO nova.compute.manager [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Detaching volume bc959167-a6fc-4d0c-9625-7ca252b92619
Oct 18 07:41:03 user nova-compute[74587]: INFO nova.virt.block_device [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Attempting to driver detach volume bc959167-a6fc-4d0c-9625-7ca252b92619 from mountpoint /dev/vdb
Oct 18 07:41:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Attempting to detach device vdb from instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:41:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:41:03 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:41:03 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:41:03 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:41:03 user nova-compute[74587]:   <serial>bc959167-a6fc-4d0c-9625-7ca252b92619</serial>
Oct 18 07:41:03 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 07:41:03 user nova-compute[74587]: </disk>
Oct 18 07:41:03 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:41:03 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully detached device vdb from instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 from the persistent domain config.
Oct 18 07:41:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:41:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:41:03 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:41:03 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:41:03 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:41:03 user nova-compute[74587]:   <serial>bc959167-a6fc-4d0c-9625-7ca252b92619</serial>
Oct 18 07:41:03 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 07:41:03 user nova-compute[74587]: </disk>
Oct 18 07:41:03 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:41:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:41:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:41:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:41:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:41:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:41:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG nova.compute.manager [req-c0095fa9-c3e3-4f17-8c86-f29544fca160 req-c6e720f1-5915-4a5c-a965-ee8963aa143d service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received event network-changed-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG nova.compute.manager [req-c0095fa9-c3e3-4f17-8c86-f29544fca160 req-c6e720f1-5915-4a5c-a965-ee8963aa143d service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Refreshing instance network info cache due to event network-changed-9cff095f-7779-4f55-994c-1d42901b058f. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c0095fa9-c3e3-4f17-8c86-f29544fca160 req-c6e720f1-5915-4a5c-a965-ee8963aa143d service nova] Acquiring lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c0095fa9-c3e3-4f17-8c86-f29544fca160 req-c6e720f1-5915-4a5c-a965-ee8963aa143d service nova] Acquired lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG nova.network.neutron [req-c0095fa9-c3e3-4f17-8c86-f29544fca160 req-c6e720f1-5915-4a5c-a965-ee8963aa143d service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Refreshing network info cache for port 9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:22 user nova-compute[74587]: INFO nova.compute.manager [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Terminating instance
Oct 18 07:41:22 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG nova.compute.manager [req-858f8aaa-47c2-4452-ab6d-9e5a6c43bee7 req-97f006f6-671f-4e5c-99b9-9d00b59400dd service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received event network-vif-unplugged-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-858f8aaa-47c2-4452-ab6d-9e5a6c43bee7 req-97f006f6-671f-4e5c-99b9-9d00b59400dd service nova] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-858f8aaa-47c2-4452-ab6d-9e5a6c43bee7 req-97f006f6-671f-4e5c-99b9-9d00b59400dd service nova] Lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-858f8aaa-47c2-4452-ab6d-9e5a6c43bee7 req-97f006f6-671f-4e5c-99b9-9d00b59400dd service nova] Lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:22 user nova-compute[74587]: DEBUG nova.compute.manager [req-858f8aaa-47c2-4452-ab6d-9e5a6c43bee7 req-97f006f6-671f-4e5c-99b9-9d00b59400dd service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] No waiting events found dispatching network-vif-unplugged-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-858f8aaa-47c2-4452-ab6d-9e5a6c43bee7 req-97f006f6-671f-4e5c-99b9-9d00b59400dd service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received event network-vif-unplugged-9cff095f-7779-4f55-994c-1d42901b058f for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.network.neutron [req-c0095fa9-c3e3-4f17-8c86-f29544fca160 req-c6e720f1-5915-4a5c-a965-ee8963aa143d service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updated VIF entry in instance network info cache for port 9cff095f-7779-4f55-994c-1d42901b058f. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.network.neutron [req-c0095fa9-c3e3-4f17-8c86-f29544fca160 req-c6e720f1-5915-4a5c-a965-ee8963aa143d service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updating instance_info_cache with network_info: [{"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c0095fa9-c3e3-4f17-8c86-f29544fca160 req-c6e720f1-5915-4a5c-a965-ee8963aa143d service nova] Releasing lock "refresh_cache-ea414a0e-7538-4490-8b78-76b852ea4214" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:23 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Instance destroyed successfully.
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lazy-loading 'resources' on Instance uuid ea414a0e-7538-4490-8b78-76b852ea4214 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:33:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1428891446',display_name='tempest-TestStampPattern-server-1428891446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1428891446',id=42,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCxWuTJ10c+whHcAUpDfDNeTRwFlH5W1d/E8jb2I/XpDzX51kKsRG9V2bdqFirsQKd0oQnenCerfZEhS8i1Eb78bX6HxHRaCTcnTxEjfRe5Q0diM4h1ECItqYcDOFplGQ==',key_name='tempest-TestStampPattern-794720162',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:33:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='714315c24629492e94635d69c58bfef0',ramdisk_id='',reservation_id='r-8t7o0ocb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-145299941',owner_user_name='tempest-TestStampPattern-145299941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:36:55Z,user_data=None,user_id='8520ff9b3a8141ada3e3d5634762fa1b',uuid=ea414a0e-7538-4490-8b78-76b852ea4214,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converting VIF {"id": "9cff095f-7779-4f55-994c-1d42901b058f", "address": "fa:16:3e:9e:f9:46", "network": {"id": "d68957b0-1a4c-4ee3-b68c-187814513156", "bridge": "br-int", "label": "tempest-TestStampPattern-409102622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "714315c24629492e94635d69c58bfef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cff095f-77", "ovs_interfaceid": "9cff095f-7779-4f55-994c-1d42901b058f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f9:46,bridge_name='br-int',has_traffic_filtering=True,id=9cff095f-7779-4f55-994c-1d42901b058f,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cff095f-77') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_vif [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f9:46,bridge_name='br-int',has_traffic_filtering=True,id=9cff095f-7779-4f55-994c-1d42901b058f,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cff095f-77') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cff095f-77, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35fc927e-4803-4815-a705-ed626e334166) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:41:23 user nova-compute[74587]: INFO os_vif [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f9:46,bridge_name='br-int',has_traffic_filtering=True,id=9cff095f-7779-4f55-994c-1d42901b058f,network=Network(d68957b0-1a4c-4ee3-b68c-187814513156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cff095f-77')
Oct 18 07:41:23 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Deleting instance files /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214_del
Oct 18 07:41:23 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Deletion of /opt/stack/data/nova/instances/ea414a0e-7538-4490-8b78-76b852ea4214_del complete
Oct 18 07:41:23 user nova-compute[74587]: INFO nova.compute.manager [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:41:23 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 is timed out.
Oct 18 07:41:23 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully detached device vdb from instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 from the live domain config.
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btNTJicx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:41:23 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f916d5-f874-4b85-acf3-54420b1c680c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:41:23 user nova-compute[74587]: No targets found.
Oct 18 07:41:23 user nova-compute[74587]: iSNS:
Oct 18 07:41:23 user nova-compute[74587]: No targets found.
Oct 18 07:41:23 user nova-compute[74587]: STATIC:
Oct 18 07:41:23 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619
Oct 18 07:41:23 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:41:23 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:41:23 user nova-compute[74587]: FIRMWARE:
Oct 18 07:41:23 user nova-compute[74587]: No targets found.
Oct 18 07:41:23 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:41:23 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:41:23 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b017738-ca88-48bf-a62a-d2b0e54fd9d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f72ef0-839b-4c4c-a7cd-1a785f4cf9bd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:41:23 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 (non-flash)
Oct 18 07:41:23 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe447b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[73473b0a-49bc-43b4-8bae-b95e62256b95]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[676115d6-12c2-4626-80ef-dbdd2a0a3b7c]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e31736b-5ee9-4cfe-8889-29425ee76357]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0f4a06-5401-4492-8335-8a9826c2bf56]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2452200-c2fc-4624-a47c-927534d4b648]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b06f38-1eb5-42aa-ab52-4997f8f2d78d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260]
Oct 18 07:41:23 user nova-compute[74587]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619, portal: 172.16.0.220,3260] successful.
Oct 18 07:41:23 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc959167-a6fc-4d0c-9625-7ca252b92619 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7172a6d3-5a1c-4739-a525-bd1ddb0f9a5d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== disconnect_volume: return (279ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:41:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:41:24 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:41:24 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Took 0.74 seconds to deallocate network for instance.
Oct 18 07:41:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:24 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:41:24 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:41:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:24 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Deleted allocations for instance ea414a0e-7538-4490-8b78-76b852ea4214
Oct 18 07:41:24 user nova-compute[74587]: DEBUG nova.compute.manager [req-c16086d4-a7ba-43dc-9d2c-bd8574985cb7 req-58617ac9-9be0-4a3d-b4f3-d34432b3754b service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received event network-vif-deleted-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:41:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4320f141-8909-4d26-819f-801c7b286df1 tempest-TestStampPattern-145299941 tempest-TestStampPattern-145299941-project-member] Lock "ea414a0e-7538-4490-8b78-76b852ea4214" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:24 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:41:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c57e67f5-0259-460c-aa1b-10061a322b25 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.806s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-b2483678-8233-4c8f-9ba5-c331cec64faa req-5a3bab03-fce8-47ce-9a56-0a2e760bc5a0 service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received event network-vif-plugged-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b2483678-8233-4c8f-9ba5-c331cec64faa req-5a3bab03-fce8-47ce-9a56-0a2e760bc5a0 service nova] Acquiring lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b2483678-8233-4c8f-9ba5-c331cec64faa req-5a3bab03-fce8-47ce-9a56-0a2e760bc5a0 service nova] Lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-b2483678-8233-4c8f-9ba5-c331cec64faa req-5a3bab03-fce8-47ce-9a56-0a2e760bc5a0 service nova] Lock "ea414a0e-7538-4490-8b78-76b852ea4214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-b2483678-8233-4c8f-9ba5-c331cec64faa req-5a3bab03-fce8-47ce-9a56-0a2e760bc5a0 service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] No waiting events found dispatching network-vif-plugged-9cff095f-7779-4f55-994c-1d42901b058f {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:41:25 user nova-compute[74587]: WARNING nova.compute.manager [req-b2483678-8233-4c8f-9ba5-c331cec64faa req-5a3bab03-fce8-47ce-9a56-0a2e760bc5a0 service nova] [instance: ea414a0e-7538-4490-8b78-76b852ea4214] Received unexpected event network-vif-plugged-9cff095f-7779-4f55-994c-1d42901b058f for instance with vm_state deleted and task_state None.
Oct 18 07:41:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-345185e9-bb68-4b02-ae6f-81d2007ebdee tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-345185e9-bb68-4b02-ae6f-81d2007ebdee tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-345185e9-bb68-4b02-ae6f-81d2007ebdee tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-345185e9-bb68-4b02-ae6f-81d2007ebdee tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74587) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG nova.objects.instance [None req-345185e9-bb68-4b02-ae6f-81d2007ebdee tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:26 user nova-compute[74587]: DEBUG nova.compute.manager [req-5fe4a5c8-dfe2-457a-9b44-e6f755685403 req-176422b3-be3b-4d1a-937f-56516825b29c service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-unplugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:41:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5fe4a5c8-dfe2-457a-9b44-e6f755685403 req-176422b3-be3b-4d1a-937f-56516825b29c service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5fe4a5c8-dfe2-457a-9b44-e6f755685403 req-176422b3-be3b-4d1a-937f-56516825b29c service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5fe4a5c8-dfe2-457a-9b44-e6f755685403 req-176422b3-be3b-4d1a-937f-56516825b29c service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:26 user nova-compute[74587]: DEBUG nova.compute.manager [req-5fe4a5c8-dfe2-457a-9b44-e6f755685403 req-176422b3-be3b-4d1a-937f-56516825b29c service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-unplugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:41:26 user nova-compute[74587]: WARNING nova.compute.manager [req-5fe4a5c8-dfe2-457a-9b44-e6f755685403 req-176422b3-be3b-4d1a-937f-56516825b29c service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-unplugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state active and task_state powering-off.
Oct 18 07:41:26 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance destroyed successfully.
Oct 18 07:41:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-345185e9-bb68-4b02-ae6f-81d2007ebdee tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:41:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-345185e9-bb68-4b02-ae6f-81d2007ebdee tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.845s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-0c5fba9d-b22d-4ab8-947b-bbe279b51ddf req-8cd29488-9e80-4bbb-b033-be74461d0571 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:41:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0c5fba9d-b22d-4ab8-947b-bbe279b51ddf req-8cd29488-9e80-4bbb-b033-be74461d0571 service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0c5fba9d-b22d-4ab8-947b-bbe279b51ddf req-8cd29488-9e80-4bbb-b033-be74461d0571 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-0c5fba9d-b22d-4ab8-947b-bbe279b51ddf req-8cd29488-9e80-4bbb-b033-be74461d0571 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-0c5fba9d-b22d-4ab8-947b-bbe279b51ddf req-8cd29488-9e80-4bbb-b033-be74461d0571 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:41:28 user nova-compute[74587]: WARNING nova.compute.manager [req-0c5fba9d-b22d-4ab8-947b-bbe279b51ddf req-8cd29488-9e80-4bbb-b033-be74461d0571 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state stopped and task_state None.
Oct 18 07:41:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:41:31 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:41:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:34 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:41:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:41:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:41:37 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:41:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:41:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:39 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:41:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:39 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:41:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:39 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:41:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:41:40 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:41:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.06533432006836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:41:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:41:41 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:41:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:41:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:41:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:41:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:41:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:41:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'flavor' on Instance uuid 8556baa1-eb26-4fc0-bd76-9424e84e7a83 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:00 user nova-compute[74587]: INFO nova.compute.manager [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Attaching volume 98cbc666-334c-4fe5-86d7-0b2c2929c662 to /dev/vdb
Oct 18 07:42:00 user nova-compute[74587]: DEBUG os_brick.utils [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d4af62-d0dd-4046-ae07-ff08b577ea33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1d5e0a-3377-4453-af97-426dcef10700]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d565ebdc-517c-4d73-b0ac-1a8d57a5b9bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5742062-73d8-40ef-a4a1-8f3343c028a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:42:00 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:42:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[89881a84-2f49-4dfe-8a0c-bb210f5bee1e]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG os_brick.utils [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:42:00 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating existing volume attachment record: 33f1f132-1bde-4364-a3ce-2f6fd64bfe2d {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:42:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:42:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:42:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:42:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:42:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:42:36 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYUxOLgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:42:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:42:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:42:37 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a6b47a-4d9a-4f11-a949-de4d5e1e2a92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:42:37 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[199882a0-f212-4deb-9ef6-e7eac7d10d02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662] added
Oct 18 07:42:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee55f2e3-6f85-4395-8912-65a7c2c389e9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d01ebe0-31de-456b-85c7-3741ec18b41c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYUxOLgc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYUxOLgc" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[57425d58-6a9a-470b-a9a1-6f58237fd20e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vYUxOLgc'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[54696e61-731f-4c2a-aa5f-7e81189fca94]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85f37d7-773e-493f-944c-4f2e69fef3d4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:42:37 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:42:37 user nova-compute[74587]:  {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:42:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 07:42:37 user nova-compute[74587]: 
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cc0029-69ad-41d6-9665-0a138857dd10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662, portal: 172.16.0.220,3260]
Oct 18 07:42:37 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662, portal: 172.16.0.220,3260] successful.
Oct 18 07:42:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82a8652-387d-4c8e-a286-67beb1347b02]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d6bd69-cea2-404e-ab7c-a8050462957f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 (non-flash)
Oct 18 07:42:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 (non-flash)
Oct 18 07:42:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb06013-28b2-4d54-a56d-f0e0ba3b2a97]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:42:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:42:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:42:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYUxOLgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:42:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:42:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23439343966666330', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:42:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439343966666330', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:42:38 user nova-compute[74587]: DEBUG nova.objects.instance [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'flavor' on Instance uuid 8556baa1-eb26-4fc0-bd76-9424e84e7a83 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:42:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:42:38 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:42:38 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:42:38 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:42:38 user nova-compute[74587]:   <serial>98cbc666-334c-4fe5-86d7-0b2c2929c662</serial>
Oct 18 07:42:38 user nova-compute[74587]: </disk>
Oct 18 07:42:38 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:42:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:42:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:42:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] No VIF found with MAC fa:16:3e:0a:eb:77, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:42:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-22e3b340-5bca-4814-af03-58d84599f015 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.944s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:40 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:42:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:42:41 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8859MB free_disk=25.054569244384766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-07ff9d06-d859-4027-87d5-01a60e47e6c1 req-1011b351-3ac4-4ac6-b1b3-f675907cc816 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-changed-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.compute.manager [req-07ff9d06-d859-4027-87d5-01a60e47e6c1 req-1011b351-3ac4-4ac6-b1b3-f675907cc816 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Refreshing instance network info cache due to event network-changed-ea118f0d-278c-4ab8-bf73-830b41c50424. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-07ff9d06-d859-4027-87d5-01a60e47e6c1 req-1011b351-3ac4-4ac6-b1b3-f675907cc816 service nova] Acquiring lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-07ff9d06-d859-4027-87d5-01a60e47e6c1 req-1011b351-3ac4-4ac6-b1b3-f675907cc816 service nova] Acquired lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:42:41 user nova-compute[74587]: DEBUG nova.network.neutron [req-07ff9d06-d859-4027-87d5-01a60e47e6c1 req-1011b351-3ac4-4ac6-b1b3-f675907cc816 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Refreshing network info cache for port ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-07ff9d06-d859-4027-87d5-01a60e47e6c1 req-1011b351-3ac4-4ac6-b1b3-f675907cc816 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updated VIF entry in instance network info cache for port ea118f0d-278c-4ab8-bf73-830b41c50424. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG nova.network.neutron [req-07ff9d06-d859-4027-87d5-01a60e47e6c1 req-1011b351-3ac4-4ac6-b1b3-f675907cc816 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating instance_info_cache with network_info: [{"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-07ff9d06-d859-4027-87d5-01a60e47e6c1 req-1011b351-3ac4-4ac6-b1b3-f675907cc816 service nova] Releasing lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:42:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:43 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updating instance_info_cache with network_info: [{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:42:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:42:43 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:42:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-165310f7-6ba2-4898-8a65-0ad86796891e req-504d24dd-59f9-4135-9de9-b369b84d4d6f service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-changed-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG nova.compute.manager [req-165310f7-6ba2-4898-8a65-0ad86796891e req-504d24dd-59f9-4135-9de9-b369b84d4d6f service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Refreshing instance network info cache due to event network-changed-ea118f0d-278c-4ab8-bf73-830b41c50424. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-165310f7-6ba2-4898-8a65-0ad86796891e req-504d24dd-59f9-4135-9de9-b369b84d4d6f service nova] Acquiring lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-165310f7-6ba2-4898-8a65-0ad86796891e req-504d24dd-59f9-4135-9de9-b369b84d4d6f service nova] Acquired lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG nova.network.neutron [req-165310f7-6ba2-4898-8a65-0ad86796891e req-504d24dd-59f9-4135-9de9-b369b84d4d6f service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Refreshing network info cache for port ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG nova.network.neutron [req-165310f7-6ba2-4898-8a65-0ad86796891e req-504d24dd-59f9-4135-9de9-b369b84d4d6f service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updated VIF entry in instance network info cache for port ea118f0d-278c-4ab8-bf73-830b41c50424. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG nova.network.neutron [req-165310f7-6ba2-4898-8a65-0ad86796891e req-504d24dd-59f9-4135-9de9-b369b84d4d6f service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating instance_info_cache with network_info: [{"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-165310f7-6ba2-4898-8a65-0ad86796891e req-504d24dd-59f9-4135-9de9-b369b84d4d6f service nova] Releasing lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:44 user nova-compute[74587]: INFO nova.compute.manager [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Rebooting instance
Oct 18 07:42:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:42:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquired lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:42:45 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:42:45 user nova-compute[74587]: DEBUG nova.network.neutron [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating instance_info_cache with network_info: [{"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:42:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Releasing lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:42:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:42:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-fe39ab9c-1c2b-43fc-9946-0915750d54aa req-ec45e931-5eb9-49de-877a-5254e8647256 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-unplugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:42:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fe39ab9c-1c2b-43fc-9946-0915750d54aa req-ec45e931-5eb9-49de-877a-5254e8647256 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fe39ab9c-1c2b-43fc-9946-0915750d54aa req-ec45e931-5eb9-49de-877a-5254e8647256 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-fe39ab9c-1c2b-43fc-9946-0915750d54aa req-ec45e931-5eb9-49de-877a-5254e8647256 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:48 user nova-compute[74587]: DEBUG nova.compute.manager [req-fe39ab9c-1c2b-43fc-9946-0915750d54aa req-ec45e931-5eb9-49de-877a-5254e8647256 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-unplugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:42:48 user nova-compute[74587]: WARNING nova.compute.manager [req-fe39ab9c-1c2b-43fc-9946-0915750d54aa req-ec45e931-5eb9-49de-877a-5254e8647256 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-unplugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state active and task_state reboot_started.
Oct 18 07:42:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:48 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Instance shutdown successfully.
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:42:50 user nova-compute[74587]: WARNING nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state active and task_state reboot_started.
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:42:50 user nova-compute[74587]: WARNING nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state active and task_state reboot_started.
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:42:50 user nova-compute[74587]: WARNING nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state active and task_state reboot_started.
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-unplugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-unplugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:42:50 user nova-compute[74587]: WARNING nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-unplugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state active and task_state reboot_started.
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:42:50 user nova-compute[74587]: WARNING nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state active and task_state reboot_started.
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:42:50 user nova-compute[74587]: WARNING nova.compute.manager [req-7ed5b21c-07aa-4221-9e61-eba0329798ee req-4dbe5b59-2bc9-40bb-9a32-079ae0390860 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state active and task_state reboot_started.
Oct 18 07:42:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:52 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Instance running successfully.
Oct 18 07:42:52 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Instance soft rebooted successfully.
Oct 18 07:42:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:42:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-a76f3c8c-7872-40be-b980-7a2ff73c6b95 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.236s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-2ebbdbe7-ce2a-4ef6-a785-330ba22da07b req-c0d9cea8-d0d8-4e24-ae8d-40d3af9443d9 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:42:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2ebbdbe7-ce2a-4ef6-a785-330ba22da07b req-c0d9cea8-d0d8-4e24-ae8d-40d3af9443d9 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:42:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2ebbdbe7-ce2a-4ef6-a785-330ba22da07b req-c0d9cea8-d0d8-4e24-ae8d-40d3af9443d9 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:42:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-2ebbdbe7-ce2a-4ef6-a785-330ba22da07b req-c0d9cea8-d0d8-4e24-ae8d-40d3af9443d9 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:42:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-2ebbdbe7-ce2a-4ef6-a785-330ba22da07b req-c0d9cea8-d0d8-4e24-ae8d-40d3af9443d9 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:42:52 user nova-compute[74587]: WARNING nova.compute.manager [req-2ebbdbe7-ce2a-4ef6-a785-330ba22da07b req-c0d9cea8-d0d8-4e24-ae8d-40d3af9443d9 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state active and task_state None.
Oct 18 07:42:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:57 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:42:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Verify base images {{(pid=74587) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Image id 00da3f3a-a4cf-47c1-9d01-6e2f43c879d4 yields fingerprint ff98de6cadfdcbbdfa1c025bfdd84349affcb175 {{(pid=74587) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] image 00da3f3a-a4cf-47c1-9d01-6e2f43c879d4 at (/opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175): checking
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] image 00da3f3a-a4cf-47c1-9d01-6e2f43c879d4 at (/opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175): image is in use {{(pid=74587) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74587) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Image id 9442f4c2-6355-454c-90aa-9dccf102d343 yields fingerprint a7713629c387e365b08db744a4455b1e092b0e76 {{(pid=74587) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] image 9442f4c2-6355-454c-90aa-9dccf102d343 at (/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76): checking
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] image 9442f4c2-6355-454c-90aa-9dccf102d343 at (/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76): image is in use {{(pid=74587) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] 8556baa1-eb26-4fc0-bd76-9424e84e7a83 is a valid instance name {{(pid=74587) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] 8556baa1-eb26-4fc0-bd76-9424e84e7a83 has a disk file {{(pid=74587) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 is backed by ff98de6cadfdcbbdfa1c025bfdd84349affcb175 {{(pid=74587) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] 671f2969-e3dc-4696-bfae-c3507e6ca2b8 is a valid instance name {{(pid=74587) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] 671f2969-e3dc-4696-bfae-c3507e6ca2b8 has a disk file {{(pid=74587) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 is backed by a7713629c387e365b08db744a4455b1e092b0e76 {{(pid=74587) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 18 07:43:00 user nova-compute[74587]: WARNING nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c
Oct 18 07:43:00 user nova-compute[74587]: WARNING nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Unknown base file: /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a
Oct 18 07:43:00 user nova-compute[74587]: WARNING nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d
Oct 18 07:43:00 user nova-compute[74587]: WARNING nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8
Oct 18 07:43:00 user nova-compute[74587]: WARNING nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb
Oct 18 07:43:00 user nova-compute[74587]: WARNING nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee
Oct 18 07:43:00 user nova-compute[74587]: WARNING nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace
Oct 18 07:43:00 user nova-compute[74587]: WARNING nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Unknown base file: /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Active base files: /opt/stack/data/nova/instances/_base/ff98de6cadfdcbbdfa1c025bfdd84349affcb175 /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Removable base files: /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8 /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3b90917d104e6418230a7ac93bf3d3ac5276648c
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/59ee723b718f44817c075f9cabc1311fb63a670a
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6aacba4e547065f6269446fc0811fb891923919d
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ad28f387dad445964a3118998ef1276550d18ad8
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a37d645e0498a7a058c5b9ab8a9d2c58b22f14fb
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c4bfec5f2ca38d03b5a655bb9d000d1df4968cee
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b44545af7e8b24dfc9fe59bb15d7e928066f5ace
Oct 18 07:43:00 user nova-compute[74587]: INFO nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/27a4a8d8b802534c1a4f7ca96efcf90187d96d7a
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Verification complete {{(pid=74587) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Verify swap images {{(pid=74587) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 18 07:43:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.imagecache [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Verify ephemeral images {{(pid=74587) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 18 07:43:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:07 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:12 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:16 user nova-compute[74587]: DEBUG nova.objects.instance [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:43:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:43:16 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquired lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:43:16 user nova-compute[74587]: DEBUG nova.network.neutron [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:43:16 user nova-compute[74587]: DEBUG nova.objects.instance [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'info_cache' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:43:16 user nova-compute[74587]: DEBUG nova.objects.base [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.network.neutron [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updating instance_info_cache with network_info: [{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Releasing lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:43:17 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance destroyed successfully.
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'resources' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.objects.base [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377656329',display_name='tempest-AttachVolumeTestJSON-server-1377656329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377656329',id=45,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQrfeDFSrh8ZGrOuYYha24ukykHfAOuD917olQ/lsJ8pA5vRSN5Ovrqsa2FwII8i56apAks0xnn4LKfO2tXejfQtuLNK5t/1FIWYyN9LDhAvbM+ogevAPTV3M42nN+uIw==',key_name='tempest-keypair-480105349',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-t5gx743d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=671f2969-e3dc-4696-bfae-c3507e6ca2b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG os_vif [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffe8a058-0f, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=976f9b6a-5b47-44d6-bc29-2aacd4543bd3) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:43:17 user nova-compute[74587]: INFO os_vif [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f')
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Start _get_guest_xml network_info=[{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'numa_topology' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.objects.base [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:43:17 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:43:17 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'vcpu_model' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.objects.base [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377656329',display_name='tempest-AttachVolumeTestJSON-server-1377656329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377656329',id=45,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQrfeDFSrh8ZGrOuYYha24ukykHfAOuD917olQ/lsJ8pA5vRSN5Ovrqsa2FwII8i56apAks0xnn4LKfO2tXejfQtuLNK5t/1FIWYyN9LDhAvbM+ogevAPTV3M42nN+uIw==',key_name='tempest-keypair-480105349',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-t5gx743d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=671f2969-e3dc-4696-bfae-c3507e6ca2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'pci_devices' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.objects.base [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:43:17 user nova-compute[74587]:   <uuid>671f2969-e3dc-4696-bfae-c3507e6ca2b8</uuid>
Oct 18 07:43:17 user nova-compute[74587]:   <name>instance-0000002d</name>
Oct 18 07:43:17 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:43:17 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:43:17 user nova-compute[74587]:   <metadata>
Oct 18 07:43:17 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:43:17 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:43:17 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeTestJSON-server-1377656329</nova:name>
Oct 18 07:43:17 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:43:17</nova:creationTime>
Oct 18 07:43:17 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:43:17 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:43:17 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:43:17 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:43:17 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:43:17 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:43:17 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:43:17 user nova-compute[74587]:       <nova:owner>
Oct 18 07:43:17 user nova-compute[74587]:         <nova:user uuid="538ad3704d374763a318647b40cac1b6">tempest-AttachVolumeTestJSON-42078443-project-member</nova:user>
Oct 18 07:43:17 user nova-compute[74587]:         <nova:project uuid="c47608ab6414451fabf82d9e34c76a94">tempest-AttachVolumeTestJSON-42078443</nova:project>
Oct 18 07:43:17 user nova-compute[74587]:       </nova:owner>
Oct 18 07:43:17 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:43:17 user nova-compute[74587]:       <nova:ports>
Oct 18 07:43:17 user nova-compute[74587]:         <nova:port uuid="ffe8a058-0f56-4b23-8ea8-36915a0014a8">
Oct 18 07:43:17 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 07:43:17 user nova-compute[74587]:         </nova:port>
Oct 18 07:43:17 user nova-compute[74587]:       </nova:ports>
Oct 18 07:43:17 user nova-compute[74587]:     </nova:instance>
Oct 18 07:43:17 user nova-compute[74587]:   </metadata>
Oct 18 07:43:17 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:43:17 user nova-compute[74587]:     <system>
Oct 18 07:43:17 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:43:17 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:43:17 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:43:17 user nova-compute[74587]:       <entry name="serial">671f2969-e3dc-4696-bfae-c3507e6ca2b8</entry>
Oct 18 07:43:17 user nova-compute[74587]:       <entry name="uuid">671f2969-e3dc-4696-bfae-c3507e6ca2b8</entry>
Oct 18 07:43:17 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:43:17 user nova-compute[74587]:     </system>
Oct 18 07:43:17 user nova-compute[74587]:   </sysinfo>
Oct 18 07:43:17 user nova-compute[74587]:   <os>
Oct 18 07:43:17 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:43:17 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:43:17 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:43:17 user nova-compute[74587]:   </os>
Oct 18 07:43:17 user nova-compute[74587]:   <features>
Oct 18 07:43:17 user nova-compute[74587]:     <acpi/>
Oct 18 07:43:17 user nova-compute[74587]:     <apic/>
Oct 18 07:43:17 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:43:17 user nova-compute[74587]:   </features>
Oct 18 07:43:17 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:43:17 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:43:17 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:43:17 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:43:17 user nova-compute[74587]:   </clock>
Oct 18 07:43:17 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:43:17 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:43:17 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:43:17 user nova-compute[74587]:   </cpu>
Oct 18 07:43:17 user nova-compute[74587]:   <devices>
Oct 18 07:43:17 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:43:17 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:43:17 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk"/>
Oct 18 07:43:17 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:43:17 user nova-compute[74587]:     </disk>
Oct 18 07:43:17 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:43:17 user nova-compute[74587]:       <mac address="fa:16:3e:40:13:f8"/>
Oct 18 07:43:17 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:43:17 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:43:17 user nova-compute[74587]:       <target dev="tapffe8a058-0f"/>
Oct 18 07:43:17 user nova-compute[74587]:     </interface>
Oct 18 07:43:17 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:43:17 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/console.log" append="off"/>
Oct 18 07:43:17 user nova-compute[74587]:     </serial>
Oct 18 07:43:17 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:43:17 user nova-compute[74587]:     <video>
Oct 18 07:43:17 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:43:17 user nova-compute[74587]:     </video>
Oct 18 07:43:17 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:43:17 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:43:17 user nova-compute[74587]:     </rng>
Oct 18 07:43:17 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:43:17 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:43:17 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:43:17 user nova-compute[74587]:     </memballoon>
Oct 18 07:43:17 user nova-compute[74587]:   </devices>
Oct 18 07:43:17 user nova-compute[74587]: </domain>
Oct 18 07:43:17 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.objects.instance [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'trusted_certs' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.objects.base [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:43:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Cannot resize image /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG nova.objects.instance [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'migration_context' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG nova.objects.base [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Object Instance<671f2969-e3dc-4696-bfae-c3507e6ca2b8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74587) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377656329',display_name='tempest-AttachVolumeTestJSON-server-1377656329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377656329',id=45,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQrfeDFSrh8ZGrOuYYha24ukykHfAOuD917olQ/lsJ8pA5vRSN5Ovrqsa2FwII8i56apAks0xnn4LKfO2tXejfQtuLNK5t/1FIWYyN9LDhAvbM+ogevAPTV3M42nN+uIw==',key_name='tempest-keypair-480105349',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-t5gx743d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=671f2969-e3dc-4696-bfae-c3507e6ca2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG os_vif [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15c00f9b-8ea7-53fa-8b99-a41ea840ca11', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffe8a058-0f, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffe8a058-0f, col_values=(('qos', UUID('fb693ad9-ebdc-47ea-ac5d-f0f76f9c6515')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffe8a058-0f, col_values=(('external_ids', {'iface-id': 'ffe8a058-0f56-4b23-8ea8-36915a0014a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:13:f8', 'vm-uuid': '671f2969-e3dc-4696-bfae-c3507e6ca2b8'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:43:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:18 user nova-compute[74587]: INFO os_vif [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f')
Oct 18 07:43:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-a71e198e-58c5-4977-a0b4-9b559cb08670 req-651984c7-2f06-4953-8a02-c55b0448d58e service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:43:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a71e198e-58c5-4977-a0b4-9b559cb08670 req-651984c7-2f06-4953-8a02-c55b0448d58e service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:43:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a71e198e-58c5-4977-a0b4-9b559cb08670 req-651984c7-2f06-4953-8a02-c55b0448d58e service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:43:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a71e198e-58c5-4977-a0b4-9b559cb08670 req-651984c7-2f06-4953-8a02-c55b0448d58e service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:43:19 user nova-compute[74587]: DEBUG nova.compute.manager [req-a71e198e-58c5-4977-a0b4-9b559cb08670 req-651984c7-2f06-4953-8a02-c55b0448d58e service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:43:19 user nova-compute[74587]: WARNING nova.compute.manager [req-a71e198e-58c5-4977-a0b4-9b559cb08670 req-651984c7-2f06-4953-8a02-c55b0448d58e service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state stopped and task_state powering-on.
Oct 18 07:43:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:43:21 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance rebooted successfully.
Oct 18 07:43:21 user nova-compute[74587]: DEBUG nova.compute.manager [None req-47d6d937-1271-47cc-bb9a-b7a509513bf5 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:43:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-5e30e23b-2945-40e4-8b98-ef597efefdfd req-cc19b92a-2a8f-4527-821d-4fc270103ab8 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:43:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5e30e23b-2945-40e4-8b98-ef597efefdfd req-cc19b92a-2a8f-4527-821d-4fc270103ab8 service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:43:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5e30e23b-2945-40e4-8b98-ef597efefdfd req-cc19b92a-2a8f-4527-821d-4fc270103ab8 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:43:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5e30e23b-2945-40e4-8b98-ef597efefdfd req-cc19b92a-2a8f-4527-821d-4fc270103ab8 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:43:21 user nova-compute[74587]: DEBUG nova.compute.manager [req-5e30e23b-2945-40e4-8b98-ef597efefdfd req-cc19b92a-2a8f-4527-821d-4fc270103ab8 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:43:21 user nova-compute[74587]: WARNING nova.compute.manager [req-5e30e23b-2945-40e4-8b98-ef597efefdfd req-cc19b92a-2a8f-4527-821d-4fc270103ab8 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state active and task_state None.
Oct 18 07:43:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:43:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:43:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:43:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:43:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:31 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:31 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:43:31 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:43:32 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:32 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:43:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:43:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:43:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:43:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:43:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:43:36 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:36 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:41 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:43:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:43:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:43:41 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:43:41 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating instance_info_cache with network_info: [{"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:43:41 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:43:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:43:42 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:43:43 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:43:43 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=25.05089569091797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:43:43 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:43:44 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:43:44 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:43:44 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:43:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:43:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:47 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:52 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:43:53 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:43:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:44:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:44:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:44:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:44:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:44:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:44:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:44:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:44:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:44:20 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:44:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:44:20 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 8556baa1-eb26-4fc0-bd76-9424e84e7a83 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:44:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:44:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:44:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:44:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:44:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:44:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:44:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:44:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:44:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:44:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:44:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:44:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:44:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:33 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:44:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:44:36 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:44:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:44:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-6d6fad88-c359-4ea1-bcb0-b5b62499d0f6 req-4ebc04fc-6c5e-4419-afbb-ef001d2c0f29 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-changed-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:44:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-6d6fad88-c359-4ea1-bcb0-b5b62499d0f6 req-4ebc04fc-6c5e-4419-afbb-ef001d2c0f29 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Refreshing instance network info cache due to event network-changed-ea118f0d-278c-4ab8-bf73-830b41c50424. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:44:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6d6fad88-c359-4ea1-bcb0-b5b62499d0f6 req-4ebc04fc-6c5e-4419-afbb-ef001d2c0f29 service nova] Acquiring lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:44:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6d6fad88-c359-4ea1-bcb0-b5b62499d0f6 req-4ebc04fc-6c5e-4419-afbb-ef001d2c0f29 service nova] Acquired lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:44:36 user nova-compute[74587]: DEBUG nova.network.neutron [req-6d6fad88-c359-4ea1-bcb0-b5b62499d0f6 req-4ebc04fc-6c5e-4419-afbb-ef001d2c0f29 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Refreshing network info cache for port ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-f15eef88-3c48-4297-a18c-41ea8dd36969 req-05c2dd5b-0ba8-4d80-9620-56e35780db71 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-changed-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-f15eef88-3c48-4297-a18c-41ea8dd36969 req-05c2dd5b-0ba8-4d80-9620-56e35780db71 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Refreshing instance network info cache due to event network-changed-ea118f0d-278c-4ab8-bf73-830b41c50424. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f15eef88-3c48-4297-a18c-41ea8dd36969 req-05c2dd5b-0ba8-4d80-9620-56e35780db71 service nova] Acquiring lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:44:37 user nova-compute[74587]: INFO nova.compute.manager [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Detaching volume 98cbc666-334c-4fe5-86d7-0b2c2929c662
Oct 18 07:44:37 user nova-compute[74587]: DEBUG nova.network.neutron [req-6d6fad88-c359-4ea1-bcb0-b5b62499d0f6 req-4ebc04fc-6c5e-4419-afbb-ef001d2c0f29 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updated VIF entry in instance network info cache for port ea118f0d-278c-4ab8-bf73-830b41c50424. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG nova.network.neutron [req-6d6fad88-c359-4ea1-bcb0-b5b62499d0f6 req-4ebc04fc-6c5e-4419-afbb-ef001d2c0f29 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating instance_info_cache with network_info: [{"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:44:37 user nova-compute[74587]: INFO nova.virt.block_device [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Attempting to driver detach volume 98cbc666-334c-4fe5-86d7-0b2c2929c662 from mountpoint /dev/vdb
Oct 18 07:44:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-6d6fad88-c359-4ea1-bcb0-b5b62499d0f6 req-4ebc04fc-6c5e-4419-afbb-ef001d2c0f29 service nova] Releasing lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f15eef88-3c48-4297-a18c-41ea8dd36969 req-05c2dd5b-0ba8-4d80-9620-56e35780db71 service nova] Acquired lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG nova.network.neutron [req-f15eef88-3c48-4297-a18c-41ea8dd36969 req-05c2dd5b-0ba8-4d80-9620-56e35780db71 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Refreshing network info cache for port ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Attempting to detach device vdb from instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:44:37 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:44:37 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:44:37 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:44:37 user nova-compute[74587]:   <serial>98cbc666-334c-4fe5-86d7-0b2c2929c662</serial>
Oct 18 07:44:37 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:44:37 user nova-compute[74587]: </disk>
Oct 18 07:44:37 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:44:37 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Successfully detached device vdb from instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 from the persistent domain config.
Oct 18 07:44:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:44:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:44:37 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:44:37 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:44:37 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:44:37 user nova-compute[74587]:   <serial>98cbc666-334c-4fe5-86d7-0b2c2929c662</serial>
Oct 18 07:44:37 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:44:37 user nova-compute[74587]: </disk>
Oct 18 07:44:37 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:44:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:44:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:44:38 user nova-compute[74587]: DEBUG nova.network.neutron [req-f15eef88-3c48-4297-a18c-41ea8dd36969 req-05c2dd5b-0ba8-4d80-9620-56e35780db71 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updated VIF entry in instance network info cache for port ea118f0d-278c-4ab8-bf73-830b41c50424. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:44:38 user nova-compute[74587]: DEBUG nova.network.neutron [req-f15eef88-3c48-4297-a18c-41ea8dd36969 req-05c2dd5b-0ba8-4d80-9620-56e35780db71 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating instance_info_cache with network_info: [{"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:44:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f15eef88-3c48-4297-a18c-41ea8dd36969 req-05c2dd5b-0ba8-4d80-9620-56e35780db71 service nova] Releasing lock "refresh_cache-8556baa1-eb26-4fc0-bd76-9424e84e7a83" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:44:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:44:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:44:39 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:44:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:44:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:44:42 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:44:42 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:44:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:44:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:44:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:44:42 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:44:42 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updating instance_info_cache with network_info: [{"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:44:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-671f2969-e3dc-4696-bfae-c3507e6ca2b8" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:44:42 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:44:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:44 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:44:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:44:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:44:44 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:44:44 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:44:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:44 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:45 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:44:45 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:44:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.049365997314453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:44:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:44:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:44:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:44:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:44:58 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 is timed out.
Oct 18 07:44:58 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Successfully detached device vdb from instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 from the live domain config.
Oct 18 07:44:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYUxOLgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:44:58 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4bcb3d-e793-432e-aaa1-81bc52cc4b8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:44:58 user nova-compute[74587]: No targets found.
Oct 18 07:44:58 user nova-compute[74587]: iSNS:
Oct 18 07:44:58 user nova-compute[74587]: No targets found.
Oct 18 07:44:58 user nova-compute[74587]: STATIC:
Oct 18 07:44:58 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662
Oct 18 07:44:58 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:44:58 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:44:58 user nova-compute[74587]: FIRMWARE:
Oct 18 07:44:58 user nova-compute[74587]: No targets found.
Oct 18 07:44:58 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:44:58 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:44:58 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b835b964-83d6-4a41-80e5-31055d7c1317]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c026b855-5d80-4925-8208-72b9604c8a41]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 (non-flash)
Oct 18 07:44:58 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 (non-flash)
Oct 18 07:44:58 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe447a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1bdfc4-4246-4862-a1f8-e5558b01f4e8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b17a2c-2b18-4d42-967a-79a2aef46ced]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aac6002-475a-44d4-889c-80f08643b45f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d02c861-2ec5-4037-b939-273789f98e7a]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6770670c-a9b3-44f8-8b3a-65c89b76ae0e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f133cbda-b587-4397-9462-d2732f3d41c4]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662, portal: 172.16.0.220,3260]
Oct 18 07:44:58 user nova-compute[74587]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662, portal: 172.16.0.220,3260] successful.
Oct 18 07:44:58 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98cbc666-334c-4fe5-86d7-0b2c2929c662 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f22f64-e239-4ec0-ae18-1307e9e3eae7]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] <== disconnect_volume: return (260ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:44:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:44:59 user nova-compute[74587]: DEBUG nova.objects.instance [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'flavor' on Instance uuid 8556baa1-eb26-4fc0-bd76-9424e84e7a83 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:44:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-8b8808a8-b8bc-4a31-94dd-c060e6a40e30 tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.723s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:45:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:45:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:45:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:45:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:08 user nova-compute[74587]: INFO nova.compute.manager [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Terminating instance
Oct 18 07:45:08 user nova-compute[74587]: DEBUG nova.compute.manager [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-9e6a67af-672e-4912-8a4d-0867c6a546ed req-73fd1e84-d562-4c8c-b411-d2fada705a13 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-unplugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9e6a67af-672e-4912-8a4d-0867c6a546ed req-73fd1e84-d562-4c8c-b411-d2fada705a13 service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9e6a67af-672e-4912-8a4d-0867c6a546ed req-73fd1e84-d562-4c8c-b411-d2fada705a13 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-9e6a67af-672e-4912-8a4d-0867c6a546ed req-73fd1e84-d562-4c8c-b411-d2fada705a13 service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-9e6a67af-672e-4912-8a4d-0867c6a546ed req-73fd1e84-d562-4c8c-b411-d2fada705a13 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-unplugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG nova.compute.manager [req-9e6a67af-672e-4912-8a4d-0867c6a546ed req-73fd1e84-d562-4c8c-b411-d2fada705a13 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-unplugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Instance destroyed successfully.
Oct 18 07:45:08 user nova-compute[74587]: DEBUG nova.objects.instance [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'resources' on Instance uuid 671f2969-e3dc-4696-bfae-c3507e6ca2b8 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377656329',display_name='tempest-AttachVolumeTestJSON-server-1377656329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377656329',id=45,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQrfeDFSrh8ZGrOuYYha24ukykHfAOuD917olQ/lsJ8pA5vRSN5Ovrqsa2FwII8i56apAks0xnn4LKfO2tXejfQtuLNK5t/1FIWYyN9LDhAvbM+ogevAPTV3M42nN+uIw==',key_name='tempest-keypair-480105349',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-t5gx743d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:43:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=671f2969-e3dc-4696-bfae-c3507e6ca2b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "address": "fa:16:3e:40:13:f8", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe8a058-0f", "ovs_interfaceid": "ffe8a058-0f56-4b23-8ea8-36915a0014a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG os_vif [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffe8a058-0f, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb693ad9-ebdc-47ea-ac5d-f0f76f9c6515) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:45:08 user nova-compute[74587]: INFO os_vif [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:13:f8,bridge_name='br-int',has_traffic_filtering=True,id=ffe8a058-0f56-4b23-8ea8-36915a0014a8,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe8a058-0f')
Oct 18 07:45:08 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Deleting instance files /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8_del
Oct 18 07:45:08 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Deletion of /opt/stack/data/nova/instances/671f2969-e3dc-4696-bfae-c3507e6ca2b8_del complete
Oct 18 07:45:08 user nova-compute[74587]: INFO nova.compute.manager [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 18 07:45:08 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:45:08 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:45:09 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:45:09 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Took 0.64 seconds to deallocate network for instance.
Oct 18 07:45:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:09 user nova-compute[74587]: DEBUG nova.compute.manager [req-6c77ea47-7e1a-41ee-9123-d0acdb284162 req-cc3f4bc6-e8e0-49c9-ba88-333e10d43dd9 service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-deleted-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:45:09 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:45:09 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:45:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:09 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Deleted allocations for instance 671f2969-e3dc-4696-bfae-c3507e6ca2b8
Oct 18 07:45:09 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-4906dc3c-077e-435a-b432-8b0135592cb7 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-02ca457e-3c30-4312-a274-5cda90bba275 req-e1527fd6-13ee-4c4d-ad72-85d9b297591a service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:45:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-02ca457e-3c30-4312-a274-5cda90bba275 req-e1527fd6-13ee-4c4d-ad72-85d9b297591a service nova] Acquiring lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-02ca457e-3c30-4312-a274-5cda90bba275 req-e1527fd6-13ee-4c4d-ad72-85d9b297591a service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:10 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-02ca457e-3c30-4312-a274-5cda90bba275 req-e1527fd6-13ee-4c4d-ad72-85d9b297591a service nova] Lock "671f2969-e3dc-4696-bfae-c3507e6ca2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:10 user nova-compute[74587]: DEBUG nova.compute.manager [req-02ca457e-3c30-4312-a274-5cda90bba275 req-e1527fd6-13ee-4c4d-ad72-85d9b297591a service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] No waiting events found dispatching network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:45:10 user nova-compute[74587]: WARNING nova.compute.manager [req-02ca457e-3c30-4312-a274-5cda90bba275 req-e1527fd6-13ee-4c4d-ad72-85d9b297591a service nova] [instance: 671f2969-e3dc-4696-bfae-c3507e6ca2b8] Received unexpected event network-vif-plugged-ffe8a058-0f56-4b23-8ea8-36915a0014a8 for instance with vm_state deleted and task_state None.
Oct 18 07:45:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:45:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:45:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:45:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:37 user nova-compute[74587]: INFO nova.compute.manager [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Terminating instance
Oct 18 07:45:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-e0f78509-0739-4505-be11-3fdcf0ec1fac req-948d1ac2-8682-4bcc-b1f8-eb739cb3fb17 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-unplugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e0f78509-0739-4505-be11-3fdcf0ec1fac req-948d1ac2-8682-4bcc-b1f8-eb739cb3fb17 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e0f78509-0739-4505-be11-3fdcf0ec1fac req-948d1ac2-8682-4bcc-b1f8-eb739cb3fb17 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e0f78509-0739-4505-be11-3fdcf0ec1fac req-948d1ac2-8682-4bcc-b1f8-eb739cb3fb17 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-e0f78509-0739-4505-be11-3fdcf0ec1fac req-948d1ac2-8682-4bcc-b1f8-eb739cb3fb17 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-unplugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:45:37 user nova-compute[74587]: DEBUG nova.compute.manager [req-e0f78509-0739-4505-be11-3fdcf0ec1fac req-948d1ac2-8682-4bcc-b1f8-eb739cb3fb17 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-unplugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:45:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Instance destroyed successfully.
Oct 18 07:45:38 user nova-compute[74587]: DEBUG nova.objects.instance [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lazy-loading 'resources' on Instance uuid 8556baa1-eb26-4fc0-bd76-9424e84e7a83 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1423278931',display_name='tempest-TestMinimumBasicScenario-server-1423278931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1423278931',id=49,image_ref='00da3f3a-a4cf-47c1-9d01-6e2f43c879d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGYAr05TWDrqBXeCnHiF5SAzboy2ATS10PMndop2dgTQ2B3dhCvmL1UtO6fvOKvtC5UohCrEilyGxD+GmoplY9pBKGaanqvLGCa9Pm0JOg67Fg5LghHTEV4z6c9fqYwww==',key_name='tempest-TestMinimumBasicScenario-17858413',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e35a447ffe7c47b0963dc60edd4b926a',ramdisk_id='',reservation_id='r-uhw0arf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='00da3f3a-a4cf-47c1-9d01-6e2f43c879d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-795187138',owner_user_name='tempest-TestMinimumBasicScenario-795187138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:42:52Z,user_data=None,user_id='51902e137d224e428fba578e2e535656',uuid=8556baa1-eb26-4fc0-bd76-9424e84e7a83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converting VIF {"id": "ea118f0d-278c-4ab8-bf73-830b41c50424", "address": "fa:16:3e:0a:eb:77", "network": {"id": "3c6e7121-5a13-4a14-94f7-5baf2b5bda74", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1781063015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35a447ffe7c47b0963dc60edd4b926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea118f0d-27", "ovs_interfaceid": "ea118f0d-278c-4ab8-bf73-830b41c50424", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:eb:77,bridge_name='br-int',has_traffic_filtering=True,id=ea118f0d-278c-4ab8-bf73-830b41c50424,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea118f0d-27') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG os_vif [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:eb:77,bridge_name='br-int',has_traffic_filtering=True,id=ea118f0d-278c-4ab8-bf73-830b41c50424,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea118f0d-27') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea118f0d-27, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d512b73-37d4-4fce-906d-54083deea1eb) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:45:38 user nova-compute[74587]: INFO os_vif [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:eb:77,bridge_name='br-int',has_traffic_filtering=True,id=ea118f0d-278c-4ab8-bf73-830b41c50424,network=Network(3c6e7121-5a13-4a14-94f7-5baf2b5bda74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea118f0d-27')
Oct 18 07:45:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Deleting instance files /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83_del
Oct 18 07:45:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Deletion of /opt/stack/data/nova/instances/8556baa1-eb26-4fc0-bd76-9424e84e7a83_del complete
Oct 18 07:45:38 user nova-compute[74587]: INFO nova.compute.manager [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 18 07:45:38 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:45:38 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:45:39 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Took 0.54 seconds to deallocate network for instance.
Oct 18 07:45:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-688f4920-829a-4889-91fe-495b02c70ce7 req-e0896307-4e6f-420a-bcdb-d091da9a8320 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-deleted-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:45:39 user nova-compute[74587]: INFO nova.compute.manager [req-688f4920-829a-4889-91fe-495b02c70ce7 req-e0896307-4e6f-420a-bcdb-d091da9a8320 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Neutron deleted interface ea118f0d-278c-4ab8-bf73-830b41c50424; detaching it from the instance and deleting it from the info cache
Oct 18 07:45:39 user nova-compute[74587]: DEBUG nova.network.neutron [req-688f4920-829a-4889-91fe-495b02c70ce7 req-e0896307-4e6f-420a-bcdb-d091da9a8320 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-688f4920-829a-4889-91fe-495b02c70ce7 req-e0896307-4e6f-420a-bcdb-d091da9a8320 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Detach interface failed, port_id=ea118f0d-278c-4ab8-bf73-830b41c50424, reason: Instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83 could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:39 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Deleted allocations for instance 8556baa1-eb26-4fc0-bd76-9424e84e7a83
Oct 18 07:45:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-edaf7af4-155b-420a-9274-776fdd78766d tempest-TestMinimumBasicScenario-795187138 tempest-TestMinimumBasicScenario-795187138-project-member] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.702s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-c9ef8b14-65dd-4a28-ac7c-63b92bae5a11 req-2a9f121d-e3d9-4296-9300-e352936373f5 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c9ef8b14-65dd-4a28-ac7c-63b92bae5a11 req-2a9f121d-e3d9-4296-9300-e352936373f5 service nova] Acquiring lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c9ef8b14-65dd-4a28-ac7c-63b92bae5a11 req-2a9f121d-e3d9-4296-9300-e352936373f5 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c9ef8b14-65dd-4a28-ac7c-63b92bae5a11 req-2a9f121d-e3d9-4296-9300-e352936373f5 service nova] Lock "8556baa1-eb26-4fc0-bd76-9424e84e7a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:39 user nova-compute[74587]: DEBUG nova.compute.manager [req-c9ef8b14-65dd-4a28-ac7c-63b92bae5a11 req-2a9f121d-e3d9-4296-9300-e352936373f5 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] No waiting events found dispatching network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:45:39 user nova-compute[74587]: WARNING nova.compute.manager [req-c9ef8b14-65dd-4a28-ac7c-63b92bae5a11 req-2a9f121d-e3d9-4296-9300-e352936373f5 service nova] [instance: 8556baa1-eb26-4fc0-bd76-9424e84e7a83] Received unexpected event network-vif-plugged-ea118f0d-278c-4ab8-bf73-830b41c50424 for instance with vm_state deleted and task_state None.
Oct 18 07:45:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:45:41 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:45:41 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:45:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:44 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:45:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:45:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:45:45 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:45:45 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:45:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=9022MB free_disk=25.095813751220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:45:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:45:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:45:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:45:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:45:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:46:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:46:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:46:01 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:46:02 user nova-compute[74587]: INFO nova.compute.claims [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Claim successful on node user
Oct 18 07:46:02 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:46:02 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:46:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG nova.policy [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '538ad3704d374763a318647b40cac1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47608ab6414451fabf82d9e34c76a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:46:02 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Creating image(s)
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "/opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "/opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.168s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:46:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk 1073741824" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Successfully created port: 1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.186s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Cannot resize image /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Ensure instance console log exists: /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Successfully updated port: 1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquired lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a3584df9-3031-4a56-99b4-495e2d905cad req-4f9cde52-531e-497c-897d-a7150f20b31a service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received event network-changed-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG nova.compute.manager [req-a3584df9-3031-4a56-99b4-495e2d905cad req-4f9cde52-531e-497c-897d-a7150f20b31a service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Refreshing instance network info cache due to event network-changed-1c39b5fa-8f3c-410d-aaa9-f98b05f16858. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a3584df9-3031-4a56-99b4-495e2d905cad req-4f9cde52-531e-497c-897d-a7150f20b31a service nova] Acquiring lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:46:03 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.network.neutron [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updating instance_info_cache with network_info: [{"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Releasing lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Instance network_info: |[{"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a3584df9-3031-4a56-99b4-495e2d905cad req-4f9cde52-531e-497c-897d-a7150f20b31a service nova] Acquired lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.network.neutron [req-a3584df9-3031-4a56-99b4-495e2d905cad req-4f9cde52-531e-497c-897d-a7150f20b31a service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Refreshing network info cache for port 1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Start _get_guest_xml network_info=[{"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:46:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:46:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-576412480',display_name='tempest-AttachVolumeTestJSON-server-576412480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-576412480',id=50,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbgXaAoNQaLtz+X7Rn/Cpy2DzuXMCk47UR8eg9hnEAnDzNe2UD0Lg+eEOl3QTf7oij2jivTyfTyKN6FWCNBOlPBviIc9eOQXTlbmHCTcuIGIqnYKJpnHGX0IJ/O7gPOmw==',key_name='tempest-keypair-993145532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-du7t7dv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=0fd22600-ad90-4b48-8277-fab739ff9540,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:03,bridge_name='br-int',has_traffic_filtering=True,id=1c39b5fa-8f3c-410d-aaa9-f98b05f16858,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c39b5fa-8f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:46:04 user nova-compute[74587]:   <uuid>0fd22600-ad90-4b48-8277-fab739ff9540</uuid>
Oct 18 07:46:04 user nova-compute[74587]:   <name>instance-00000032</name>
Oct 18 07:46:04 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:46:04 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:46:04 user nova-compute[74587]:   <metadata>
Oct 18 07:46:04 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:46:04 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:46:04 user nova-compute[74587]:       <nova:name>tempest-AttachVolumeTestJSON-server-576412480</nova:name>
Oct 18 07:46:04 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:46:04</nova:creationTime>
Oct 18 07:46:04 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:46:04 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:46:04 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:46:04 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:46:04 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:46:04 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:46:04 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:46:04 user nova-compute[74587]:       <nova:owner>
Oct 18 07:46:04 user nova-compute[74587]:         <nova:user uuid="538ad3704d374763a318647b40cac1b6">tempest-AttachVolumeTestJSON-42078443-project-member</nova:user>
Oct 18 07:46:04 user nova-compute[74587]:         <nova:project uuid="c47608ab6414451fabf82d9e34c76a94">tempest-AttachVolumeTestJSON-42078443</nova:project>
Oct 18 07:46:04 user nova-compute[74587]:       </nova:owner>
Oct 18 07:46:04 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:46:04 user nova-compute[74587]:       <nova:ports>
Oct 18 07:46:04 user nova-compute[74587]:         <nova:port uuid="1c39b5fa-8f3c-410d-aaa9-f98b05f16858">
Oct 18 07:46:04 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 07:46:04 user nova-compute[74587]:         </nova:port>
Oct 18 07:46:04 user nova-compute[74587]:       </nova:ports>
Oct 18 07:46:04 user nova-compute[74587]:     </nova:instance>
Oct 18 07:46:04 user nova-compute[74587]:   </metadata>
Oct 18 07:46:04 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:46:04 user nova-compute[74587]:     <system>
Oct 18 07:46:04 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:46:04 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:46:04 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:46:04 user nova-compute[74587]:       <entry name="serial">0fd22600-ad90-4b48-8277-fab739ff9540</entry>
Oct 18 07:46:04 user nova-compute[74587]:       <entry name="uuid">0fd22600-ad90-4b48-8277-fab739ff9540</entry>
Oct 18 07:46:04 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:46:04 user nova-compute[74587]:     </system>
Oct 18 07:46:04 user nova-compute[74587]:   </sysinfo>
Oct 18 07:46:04 user nova-compute[74587]:   <os>
Oct 18 07:46:04 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:46:04 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:46:04 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:46:04 user nova-compute[74587]:   </os>
Oct 18 07:46:04 user nova-compute[74587]:   <features>
Oct 18 07:46:04 user nova-compute[74587]:     <acpi/>
Oct 18 07:46:04 user nova-compute[74587]:     <apic/>
Oct 18 07:46:04 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:46:04 user nova-compute[74587]:   </features>
Oct 18 07:46:04 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:46:04 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:46:04 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:46:04 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:46:04 user nova-compute[74587]:   </clock>
Oct 18 07:46:04 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:46:04 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:46:04 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:46:04 user nova-compute[74587]:   </cpu>
Oct 18 07:46:04 user nova-compute[74587]:   <devices>
Oct 18 07:46:04 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:46:04 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:46:04 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk"/>
Oct 18 07:46:04 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:46:04 user nova-compute[74587]:     </disk>
Oct 18 07:46:04 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:46:04 user nova-compute[74587]:       <mac address="fa:16:3e:10:18:03"/>
Oct 18 07:46:04 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:46:04 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:46:04 user nova-compute[74587]:       <target dev="tap1c39b5fa-8f"/>
Oct 18 07:46:04 user nova-compute[74587]:     </interface>
Oct 18 07:46:04 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:46:04 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/console.log" append="off"/>
Oct 18 07:46:04 user nova-compute[74587]:     </serial>
Oct 18 07:46:04 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:46:04 user nova-compute[74587]:     <video>
Oct 18 07:46:04 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:46:04 user nova-compute[74587]:     </video>
Oct 18 07:46:04 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:46:04 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:46:04 user nova-compute[74587]:     </rng>
Oct 18 07:46:04 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:46:04 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:46:04 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:46:04 user nova-compute[74587]:     </memballoon>
Oct 18 07:46:04 user nova-compute[74587]:   </devices>
Oct 18 07:46:04 user nova-compute[74587]: </domain>
Oct 18 07:46:04 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-576412480',display_name='tempest-AttachVolumeTestJSON-server-576412480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-576412480',id=50,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbgXaAoNQaLtz+X7Rn/Cpy2DzuXMCk47UR8eg9hnEAnDzNe2UD0Lg+eEOl3QTf7oij2jivTyfTyKN6FWCNBOlPBviIc9eOQXTlbmHCTcuIGIqnYKJpnHGX0IJ/O7gPOmw==',key_name='tempest-keypair-993145532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-du7t7dv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=0fd22600-ad90-4b48-8277-fab739ff9540,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:03,bridge_name='br-int',has_traffic_filtering=True,id=1c39b5fa-8f3c-410d-aaa9-f98b05f16858,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c39b5fa-8f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG os_vif [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:03,bridge_name='br-int',has_traffic_filtering=True,id=1c39b5fa-8f3c-410d-aaa9-f98b05f16858,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c39b5fa-8f') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a6290de-8809-5a07-9b45-f022075099af', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c39b5fa-8f, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c39b5fa-8f, col_values=(('qos', UUID('ca3537ee-1ad3-4177-8ebe-e57c8af7a118')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c39b5fa-8f, col_values=(('external_ids', {'iface-id': '1c39b5fa-8f3c-410d-aaa9-f98b05f16858', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:18:03', 'vm-uuid': '0fd22600-ad90-4b48-8277-fab739ff9540'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:04 user nova-compute[74587]: INFO os_vif [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:03,bridge_name='br-int',has_traffic_filtering=True,id=1c39b5fa-8f3c-410d-aaa9-f98b05f16858,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c39b5fa-8f')
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No VIF found with MAC fa:16:3e:10:18:03, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.network.neutron [req-a3584df9-3031-4a56-99b4-495e2d905cad req-4f9cde52-531e-497c-897d-a7150f20b31a service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updated VIF entry in instance network info cache for port 1c39b5fa-8f3c-410d-aaa9-f98b05f16858. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG nova.network.neutron [req-a3584df9-3031-4a56-99b4-495e2d905cad req-4f9cde52-531e-497c-897d-a7150f20b31a service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updating instance_info_cache with network_info: [{"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:46:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-a3584df9-3031-4a56-99b4-495e2d905cad req-4f9cde52-531e-497c-897d-a7150f20b31a service nova] Releasing lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:46:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-4b9e5347-e937-48b7-980f-b4784b311a31 req-702c6161-1de9-4eb1-999f-008eca0d5152 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received event network-vif-plugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:46:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4b9e5347-e937-48b7-980f-b4784b311a31 req-702c6161-1de9-4eb1-999f-008eca0d5152 service nova] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:46:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4b9e5347-e937-48b7-980f-b4784b311a31 req-702c6161-1de9-4eb1-999f-008eca0d5152 service nova] Lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:46:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4b9e5347-e937-48b7-980f-b4784b311a31 req-702c6161-1de9-4eb1-999f-008eca0d5152 service nova] Lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:46:05 user nova-compute[74587]: DEBUG nova.compute.manager [req-4b9e5347-e937-48b7-980f-b4784b311a31 req-702c6161-1de9-4eb1-999f-008eca0d5152 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] No waiting events found dispatching network-vif-plugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:46:05 user nova-compute[74587]: WARNING nova.compute.manager [req-4b9e5347-e937-48b7-980f-b4784b311a31 req-702c6161-1de9-4eb1-999f-008eca0d5152 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received unexpected event network-vif-plugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 for instance with vm_state building and task_state spawning.
Oct 18 07:46:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:46:07 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Instance spawned successfully.
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-48b63631-040a-400d-b1b6-ba18ab3bf04a req-8dc78efb-77c9-495f-8fed-7e088fa30579 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received event network-vif-plugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-48b63631-040a-400d-b1b6-ba18ab3bf04a req-8dc78efb-77c9-495f-8fed-7e088fa30579 service nova] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-48b63631-040a-400d-b1b6-ba18ab3bf04a req-8dc78efb-77c9-495f-8fed-7e088fa30579 service nova] Lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-48b63631-040a-400d-b1b6-ba18ab3bf04a req-8dc78efb-77c9-495f-8fed-7e088fa30579 service nova] Lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.compute.manager [req-48b63631-040a-400d-b1b6-ba18ab3bf04a req-8dc78efb-77c9-495f-8fed-7e088fa30579 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] No waiting events found dispatching network-vif-plugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:46:07 user nova-compute[74587]: WARNING nova.compute.manager [req-48b63631-040a-400d-b1b6-ba18ab3bf04a req-8dc78efb-77c9-495f-8fed-7e088fa30579 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received unexpected event network-vif-plugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 for instance with vm_state building and task_state spawning.
Oct 18 07:46:07 user nova-compute[74587]: INFO nova.compute.manager [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Took 5.24 seconds to spawn the instance on the hypervisor.
Oct 18 07:46:07 user nova-compute[74587]: DEBUG nova.compute.manager [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:46:07 user nova-compute[74587]: INFO nova.compute.manager [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Took 5.81 seconds to build instance.
Oct 18 07:46:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e944d24c-d49f-49c9-a72c-38de6058a376 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.911s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:46:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:46:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:46:37 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:46:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:41 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:46:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:46:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:46:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updating instance_info_cache with network_info: [{"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:46:45 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:46:46 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:46:46 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:46:46 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.105079650878906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0fd22600-ad90-4b48-8277-fab739ff9540 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:46:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:46:47 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:46:48 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:46:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:46:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:47:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:47:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:47:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:47:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:47:35 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:47:35 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:47:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:47:39 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:47:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:47:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:47:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:47:44 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:47:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:47:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:47:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:47:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:47:45 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:47:45 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:47:45 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:47:46 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updating instance_info_cache with network_info: [{"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:47:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:47:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:47:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:47:47 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:47:47 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:47:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:47:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:47:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:47:47 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:47:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:47:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:47:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:47:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:47:48 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:47:48 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:47:48 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.104511260986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:47:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:47:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:47:48 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0fd22600-ad90-4b48-8277-fab739ff9540 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:47:48 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:47:48 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:47:48 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:47:48 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:47:48 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:47:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:47:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:50 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:47:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-4462940c-a6c0-4c5a-85f5-8f06bcce5137 req-45f981ca-ca7a-4f34-8a67-6e372890c4b1 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received event network-changed-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:47:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-4462940c-a6c0-4c5a-85f5-8f06bcce5137 req-45f981ca-ca7a-4f34-8a67-6e372890c4b1 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Refreshing instance network info cache due to event network-changed-1c39b5fa-8f3c-410d-aaa9-f98b05f16858. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:47:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4462940c-a6c0-4c5a-85f5-8f06bcce5137 req-45f981ca-ca7a-4f34-8a67-6e372890c4b1 service nova] Acquiring lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:47:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4462940c-a6c0-4c5a-85f5-8f06bcce5137 req-45f981ca-ca7a-4f34-8a67-6e372890c4b1 service nova] Acquired lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:47:52 user nova-compute[74587]: DEBUG nova.network.neutron [req-4462940c-a6c0-4c5a-85f5-8f06bcce5137 req-45f981ca-ca7a-4f34-8a67-6e372890c4b1 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Refreshing network info cache for port 1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:47:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:53 user nova-compute[74587]: DEBUG nova.network.neutron [req-4462940c-a6c0-4c5a-85f5-8f06bcce5137 req-45f981ca-ca7a-4f34-8a67-6e372890c4b1 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updated VIF entry in instance network info cache for port 1c39b5fa-8f3c-410d-aaa9-f98b05f16858. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:47:53 user nova-compute[74587]: DEBUG nova.network.neutron [req-4462940c-a6c0-4c5a-85f5-8f06bcce5137 req-45f981ca-ca7a-4f34-8a67-6e372890c4b1 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updating instance_info_cache with network_info: [{"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:47:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4462940c-a6c0-4c5a-85f5-8f06bcce5137 req-45f981ca-ca7a-4f34-8a67-6e372890c4b1 service nova] Releasing lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:47:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG nova.objects.instance [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:47:57 user nova-compute[74587]: INFO nova.compute.manager [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Attaching volume c82cbb7c-d8da-45e3-8c95-d239071934f5 to /dev/vdb
Oct 18 07:47:57 user nova-compute[74587]: DEBUG os_brick.utils [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[45145515-842c-4095-b2db-fb3d2e3472de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab20c5e9-bb90-4740-856a-b49c424d2dee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17b4a56-1399-4989-af0f-34075d660f31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda538ae-6e8f-4a26-b542-03b5797dd862]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:47:57 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:47:57 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[355dd7d5-4fc4-415b-8a2b-09d46d5eebed]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG os_brick.utils [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:47:57 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updating existing volume attachment record: ce218e06-7e91-40a7-b9cb-0fc228604c56 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:47:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:47:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZimdlpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:48:13 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:48:13 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:48:13 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4dcf14-b114-4239-92b3-7084b608b67c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:48:13 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6dff89-6dea-4404-b247-bddb8677246f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5] added
Oct 18 07:48:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8f1cce-ac11-498f-a131-26e039a867ec]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75020fa-16f4-4724-8241-c0331c0173a2]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZimdlpB {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZimdlpB" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7499a9b1-bf41-4ae4-b9f8-37277fac7759]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZimdlpB'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[33518252-759d-4c18-afbd-5a7f5963d04d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[40544b95-abf0-41fe-a7a1-0be6c0c16c05]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:48:13 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:48:13 user nova-compute[74587]:  {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:48:13 user nova-compute[74587]: WARNING os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 07:48:13 user nova-compute[74587]: 
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc4673c-5e36-449e-bac9-2289b1382472]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5, portal: 172.16.0.220,3260]
Oct 18 07:48:13 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5, portal: 172.16.0.220,3260] successful.
Oct 18 07:48:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb460db-4ba9-4365-8cf0-70809dcc88ea]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5666cb7c-adac-4d69-b580-237c452fb91a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)
Oct 18 07:48:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)
Oct 18 07:48:13 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:48:13 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:14 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:14 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b11d4fd-118b-4881-ae7d-92140e6f0663]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:14 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:48:14 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZimdlpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:48:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:48:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:48:15 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26639613661646531', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:48:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639613661646531', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:48:15 user nova-compute[74587]: DEBUG nova.objects.instance [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:48:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:48:15 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:48:15 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:48:15 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:48:15 user nova-compute[74587]:   <serial>c82cbb7c-d8da-45e3-8c95-d239071934f5</serial>
Oct 18 07:48:15 user nova-compute[74587]: </disk>
Oct 18 07:48:15 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:48:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:48:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:48:15 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No VIF found with MAC fa:16:3e:10:18:03, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:48:15 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6116789b-6847-4603-a83a-c53350e5eeeb tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.825s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:48:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:48:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:48:20 user nova-compute[74587]: DEBUG nova.objects.instance [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:48:20 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:48:21 user nova-compute[74587]: INFO nova.compute.manager [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Attaching volume 32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e to /dev/vdc
Oct 18 07:48:21 user nova-compute[74587]: DEBUG os_brick.utils [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b7ec54-48da-4613-9bdf-03a254195b98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b24dab-eea1-4ce0-9c59-5f1e93b99788]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e11584-1da1-4d44-98fd-f9e350e8137f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a3ffb1-e925-4214-b85a-62bfc59584f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:48:21 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:48:21 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9672cdfa-ac3c-4be4-b7e0-dcc0188d52ed]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG os_brick.utils [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:48:21 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updating existing volume attachment record: bc0d49e3-c854-4327-848e-a7448783f12b {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:48:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:48:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:48:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:48:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:48:34 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:36 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:48:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxGTKeND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:48:36 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:48:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:48:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:48:36 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:48:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:48:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:48:36 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:48:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:36 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e560c375-511e-4439-89ba-c7150cfdcd8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:36 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:48:36 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:36 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe4fe25-bdc1-467e-be85-8c8db94ade0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e] added
Oct 18 07:48:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b691ea6b-3ea1-472f-b390-636fd9a90d54]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19442e8-7a6b-43e7-bdd6-d716e39a3c8d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxGTKeND {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxGTKeND" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[83457420-263f-43cb-882a-69aa60fdf4c9]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lxGTKeND'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fd3291-98cc-47ae-96b5-23a08c7e3f57]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebd5f98-9214-4058-8866-d233ac1db12d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)
Oct 18 07:48:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)
Oct 18 07:48:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a875c8-b5b6-4438-b6f2-5aa0e5706c61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e, portal: 172.16.0.220,3260]
Oct 18 07:48:37 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e, portal: 172.16.0.220,3260] successful.
Oct 18 07:48:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[47773665-e97c-428c-8dc5-00ba6a7d884d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fb88f9-1c3f-4aba-9060-c96f18f571f2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)
Oct 18 07:48:37 user nova-compute[74587]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e (non-flash)
Oct 18 07:48:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)
Oct 18 07:48:37 user nova-compute[74587]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e (non-flash)
Oct 18 07:48:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[037c706b-815a-4102-ac70-42d836fb9c65]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:37 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxGTKeND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26438633232393062', 'path': '/dev/sdc'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438633232393062', 'path': '/dev/sdc'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG nova.objects.instance [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:48:38 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:48:38 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:48:38 user nova-compute[74587]:   <target dev="vdc" bus="virtio"/>
Oct 18 07:48:38 user nova-compute[74587]:   <serial>32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e</serial>
Oct 18 07:48:38 user nova-compute[74587]: </disk>
Oct 18 07:48:38 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] No VIF found with MAC fa:16:3e:10:18:03, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:48:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-585fc866-e6ad-4a72-9ccb-a87155722f2a tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.792s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:48:39 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:48:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:48:39 user nova-compute[74587]: INFO nova.compute.manager [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Detaching volume c82cbb7c-d8da-45e3-8c95-d239071934f5
Oct 18 07:48:39 user nova-compute[74587]: INFO nova.virt.block_device [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Attempting to driver detach volume c82cbb7c-d8da-45e3-8c95-d239071934f5 from mountpoint /dev/vdb
Oct 18 07:48:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Attempting to detach device vdb from instance 0fd22600-ad90-4b48-8277-fab739ff9540 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:48:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:48:39 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:48:39 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:48:39 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:48:39 user nova-compute[74587]:   <serial>c82cbb7c-d8da-45e3-8c95-d239071934f5</serial>
Oct 18 07:48:39 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:48:39 user nova-compute[74587]: </disk>
Oct 18 07:48:39 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:48:39 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully detached device vdb from instance 0fd22600-ad90-4b48-8277-fab739ff9540 from the persistent domain config.
Oct 18 07:48:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fd22600-ad90-4b48-8277-fab739ff9540 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:48:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:48:39 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:48:39 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:48:39 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:48:39 user nova-compute[74587]:   <serial>c82cbb7c-d8da-45e3-8c95-d239071934f5</serial>
Oct 18 07:48:39 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:48:39 user nova-compute[74587]: </disk>
Oct 18 07:48:39 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:48:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:48:41 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:44 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:44 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:48:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:48:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:48:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:48:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:48:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:48:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:48:46 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:48:46 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:48:46 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updating instance_info_cache with network_info: [{"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:48:46 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-0fd22600-ad90-4b48-8277-fab739ff9540" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:48:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:48:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:48:48 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:48:48 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=25.103076934814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 0fd22600-ad90-4b48-8277-fab739ff9540 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:48:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:48:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:48:50 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:50 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:53 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:48:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:48:59 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:00 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0fd22600-ad90-4b48-8277-fab739ff9540 is timed out.
Oct 18 07:49:00 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully detached device vdb from instance 0fd22600-ad90-4b48-8277-fab739ff9540 from the live domain config.
Oct 18 07:49:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZimdlpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:49:00 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[326e17b6-6ead-4ef0-9b8b-1f745f3f2080]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:49:00 user nova-compute[74587]: No targets found.
Oct 18 07:49:00 user nova-compute[74587]: iSNS:
Oct 18 07:49:00 user nova-compute[74587]: No targets found.
Oct 18 07:49:00 user nova-compute[74587]: STATIC:
Oct 18 07:49:00 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5
Oct 18 07:49:00 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:49:00 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:49:00 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e
Oct 18 07:49:00 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:49:00 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:49:00 user nova-compute[74587]: FIRMWARE:
Oct 18 07:49:00 user nova-compute[74587]: No targets found.
Oct 18 07:49:00 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:49:00 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:49:00 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2e259-caa1-4e57-b69d-5d73fa59f367]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6342932c-4137-453a-9f67-961766484349]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)
Oct 18 07:49:00 user nova-compute[74587]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e (non-flash)
Oct 18 07:49:00 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 (non-flash)
Oct 18 07:49:00 user nova-compute[74587]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e (non-flash)
Oct 18 07:49:00 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4326a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a2d898-bdf0-4467-a3f5-5130e1cc611b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29e086d-525b-48b1-8400-362d4c78806e]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53a67c5-3a68-4daf-814c-718c5c932f66]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ded938-e7cc-4379-9819-a867e7b1defd]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[981383d5-ac17-4a5e-91a9-34eb56175f96]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088dbdf-bffd-4ab0-8f2b-e80a3080223c]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5, portal: 172.16.0.220,3260]
Oct 18 07:49:00 user nova-compute[74587]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5, portal: 172.16.0.220,3260] successful.
Oct 18 07:49:00 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82cbb7c-d8da-45e3-8c95-d239071934f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee13a0c-91f5-46aa-8c2f-315fbb0ca62a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== disconnect_volume: return (318ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:49:00 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:49:01 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:49:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f5432832-a76a-49a3-b45d-ffd5f9aa50fa tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.707s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:49:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:49:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:49:02 user nova-compute[74587]: INFO nova.compute.manager [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Detaching volume 32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e
Oct 18 07:49:02 user nova-compute[74587]: INFO nova.virt.block_device [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Attempting to driver detach volume 32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e from mountpoint /dev/vdc
Oct 18 07:49:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Attempting to detach device vdc from instance 0fd22600-ad90-4b48-8277-fab739ff9540 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:49:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:49:02 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:49:02 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:49:02 user nova-compute[74587]:   <target dev="vdc" bus="virtio"/>
Oct 18 07:49:02 user nova-compute[74587]:   <serial>32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e</serial>
Oct 18 07:49:02 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 07:49:02 user nova-compute[74587]: </disk>
Oct 18 07:49:02 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:49:02 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully detached device vdc from instance 0fd22600-ad90-4b48-8277-fab739ff9540 from the persistent domain config.
Oct 18 07:49:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0fd22600-ad90-4b48-8277-fab739ff9540 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:49:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:49:02 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:49:02 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:49:02 user nova-compute[74587]:   <target dev="vdc" bus="virtio"/>
Oct 18 07:49:02 user nova-compute[74587]:   <serial>32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e</serial>
Oct 18 07:49:02 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 07:49:02 user nova-compute[74587]: </disk>
Oct 18 07:49:02 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:49:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:49:04 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:09 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:19 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:22 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0fd22600-ad90-4b48-8277-fab739ff9540 is timed out.
Oct 18 07:49:22 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully detached device vdc from instance 0fd22600-ad90-4b48-8277-fab739ff9540 from the live domain config.
Oct 18 07:49:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxGTKeND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:49:22 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[84993101-94b1-4865-8755-422acabdb3eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:49:22 user nova-compute[74587]: No targets found.
Oct 18 07:49:22 user nova-compute[74587]: iSNS:
Oct 18 07:49:22 user nova-compute[74587]: No targets found.
Oct 18 07:49:22 user nova-compute[74587]: STATIC:
Oct 18 07:49:22 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e
Oct 18 07:49:22 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:49:22 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:49:22 user nova-compute[74587]: FIRMWARE:
Oct 18 07:49:22 user nova-compute[74587]: No targets found.
Oct 18 07:49:22 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:49:22 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:49:22 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8498f48-4f7d-437a-aa50-d54181b2d822]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[550ca730-7642-44d9-ab6b-964e890dec06]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e (non-flash)
Oct 18 07:49:22 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e (non-flash)
Oct 18 07:49:22 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f10082be0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e'): ({'sdc'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Removing single pathed devices sdc {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b937d791-cb7d-4ac8-8b94-9a8a3d415a36]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85ce732-e242-4161-b919-4abc1e1b5946]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Flushing IO for device /dev/sdc {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb68454d-7f8a-4bd6-8275-319252dd1880]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e8e0a-afc7-4467-91f7-126d37f0a277]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb0b8f8-658d-4f9f-8a93-f04b761923cb]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e2264a-64c3-4e6a-99b1-f5dd752f8a28]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e, portal: 172.16.0.220,3260]
Oct 18 07:49:23 user nova-compute[74587]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e, portal: 172.16.0.220,3260] successful.
Oct 18 07:49:23 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c5d8e0-c22d-43cb-b189-2cb5b7b8d54e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fab737-7849-47c5-be08-184e80ef2528]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] <== disconnect_volume: return (305ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:49:23 user nova-compute[74587]: DEBUG nova.objects.instance [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'flavor' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:49:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-242b815f-0afb-4f5c-840f-bc65050af87b tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.709s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:49:24 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:49:25 user nova-compute[74587]: INFO nova.compute.manager [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Terminating instance
Oct 18 07:49:25 user nova-compute[74587]: DEBUG nova.compute.manager [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-ebbce4a8-87de-43c0-93d3-5bfd572c8df2 req-95195d69-8257-4e7f-817a-812bb6497e0b service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received event network-vif-unplugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ebbce4a8-87de-43c0-93d3-5bfd572c8df2 req-95195d69-8257-4e7f-817a-812bb6497e0b service nova] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ebbce4a8-87de-43c0-93d3-5bfd572c8df2 req-95195d69-8257-4e7f-817a-812bb6497e0b service nova] Lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-ebbce4a8-87de-43c0-93d3-5bfd572c8df2 req-95195d69-8257-4e7f-817a-812bb6497e0b service nova] Lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-ebbce4a8-87de-43c0-93d3-5bfd572c8df2 req-95195d69-8257-4e7f-817a-812bb6497e0b service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] No waiting events found dispatching network-vif-unplugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG nova.compute.manager [req-ebbce4a8-87de-43c0-93d3-5bfd572c8df2 req-95195d69-8257-4e7f-817a-812bb6497e0b service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received event network-vif-unplugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Instance destroyed successfully.
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.objects.instance [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lazy-loading 'resources' on Instance uuid 0fd22600-ad90-4b48-8277-fab739ff9540 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-576412480',display_name='tempest-AttachVolumeTestJSON-server-576412480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-576412480',id=50,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbgXaAoNQaLtz+X7Rn/Cpy2DzuXMCk47UR8eg9hnEAnDzNe2UD0Lg+eEOl3QTf7oij2jivTyfTyKN6FWCNBOlPBviIc9eOQXTlbmHCTcuIGIqnYKJpnHGX0IJ/O7gPOmw==',key_name='tempest-keypair-993145532',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:46:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c47608ab6414451fabf82d9e34c76a94',ramdisk_id='',reservation_id='r-du7t7dv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-42078443',owner_user_name='tempest-AttachVolumeTestJSON-42078443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='538ad3704d374763a318647b40cac1b6',uuid=0fd22600-ad90-4b48-8277-fab739ff9540,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converting VIF {"id": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "address": "fa:16:3e:10:18:03", "network": {"id": "54d0076c-e62d-4f5a-876f-cce5ac3aa7ed", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-654604026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47608ab6414451fabf82d9e34c76a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c39b5fa-8f", "ovs_interfaceid": "1c39b5fa-8f3c-410d-aaa9-f98b05f16858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:18:03,bridge_name='br-int',has_traffic_filtering=True,id=1c39b5fa-8f3c-410d-aaa9-f98b05f16858,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c39b5fa-8f') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG os_vif [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:18:03,bridge_name='br-int',has_traffic_filtering=True,id=1c39b5fa-8f3c-410d-aaa9-f98b05f16858,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c39b5fa-8f') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c39b5fa-8f, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca3537ee-1ad3-4177-8ebe-e57c8af7a118) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: INFO os_vif [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:18:03,bridge_name='br-int',has_traffic_filtering=True,id=1c39b5fa-8f3c-410d-aaa9-f98b05f16858,network=Network(54d0076c-e62d-4f5a-876f-cce5ac3aa7ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c39b5fa-8f')
Oct 18 07:49:26 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Deleting instance files /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540_del
Oct 18 07:49:26 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Deletion of /opt/stack/data/nova/instances/0fd22600-ad90-4b48-8277-fab739ff9540_del complete
Oct 18 07:49:26 user nova-compute[74587]: INFO nova.compute.manager [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 18 07:49:26 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:49:26 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Took 0.64 seconds to deallocate network for instance.
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.compute.manager [req-94d4f37d-d278-45c5-91e4-44c8ca2a3544 req-7455851f-0cfc-4173-88c0-81fb2f7162fd service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received event network-vif-deleted-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:49:26 user nova-compute[74587]: INFO nova.compute.manager [req-94d4f37d-d278-45c5-91e4-44c8ca2a3544 req-7455851f-0cfc-4173-88c0-81fb2f7162fd service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Neutron deleted interface 1c39b5fa-8f3c-410d-aaa9-f98b05f16858; detaching it from the instance and deleting it from the info cache
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.network.neutron [req-94d4f37d-d278-45c5-91e4-44c8ca2a3544 req-7455851f-0cfc-4173-88c0-81fb2f7162fd service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.compute.manager [req-94d4f37d-d278-45c5-91e4-44c8ca2a3544 req-7455851f-0cfc-4173-88c0-81fb2f7162fd service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Detach interface failed, port_id=1c39b5fa-8f3c-410d-aaa9-f98b05f16858, reason: Instance 0fd22600-ad90-4b48-8277-fab739ff9540 could not be found. {{(pid=74587) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:49:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:49:27 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Deleted allocations for instance 0fd22600-ad90-4b48-8277-fab739ff9540
Oct 18 07:49:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-6d6502c1-9c17-42a8-9065-6dea42087066 tempest-AttachVolumeTestJSON-42078443 tempest-AttachVolumeTestJSON-42078443-project-member] Lock "0fd22600-ad90-4b48-8277-fab739ff9540" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.952s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:49:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-429d09c6-67ca-4a83-99a3-cdc9db72705a req-41afae50-6324-45a9-9abe-603a31b747f9 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received event network-vif-plugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:49:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-429d09c6-67ca-4a83-99a3-cdc9db72705a req-41afae50-6324-45a9-9abe-603a31b747f9 service nova] Acquiring lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:49:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-429d09c6-67ca-4a83-99a3-cdc9db72705a req-41afae50-6324-45a9-9abe-603a31b747f9 service nova] Lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:49:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-429d09c6-67ca-4a83-99a3-cdc9db72705a req-41afae50-6324-45a9-9abe-603a31b747f9 service nova] Lock "0fd22600-ad90-4b48-8277-fab739ff9540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:49:27 user nova-compute[74587]: DEBUG nova.compute.manager [req-429d09c6-67ca-4a83-99a3-cdc9db72705a req-41afae50-6324-45a9-9abe-603a31b747f9 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] No waiting events found dispatching network-vif-plugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:49:27 user nova-compute[74587]: WARNING nova.compute.manager [req-429d09c6-67ca-4a83-99a3-cdc9db72705a req-41afae50-6324-45a9-9abe-603a31b747f9 service nova] [instance: 0fd22600-ad90-4b48-8277-fab739ff9540] Received unexpected event network-vif-plugged-1c39b5fa-8f3c-410d-aaa9-f98b05f16858 for instance with vm_state deleted and task_state None.
Oct 18 07:49:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:49:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:49:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:49:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:49:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:49:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:49:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:49:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:49:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:49:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:49:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:49:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:49:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:49:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:49:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:49:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:49:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:49:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:49:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:49:47 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:49:47 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:49:47 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=9123MB free_disk=25.12990951538086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:49:47 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:49:48 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:49:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:49:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:49:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:49:50 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:49:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:49:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:49:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:49:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:49:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:49:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:51 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:49:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:49:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:49:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:49:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:49:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:49:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:50:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:50:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:50:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:50:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:50:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:50:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:50:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:50:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:50:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:50:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:50:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:50:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:50:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:50:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:50:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:50:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:50:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:50:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:50:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:50:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:50:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:50:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:50:48 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:50:49 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:50:49 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:50:49 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=9136MB free_disk=25.128433227539062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:50:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:50:50 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:50:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:50:53 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:50:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:50:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:50:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:50:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:50:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:50:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:51:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:51:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:17 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:51:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:51:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:51:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:51:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:51:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:51:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:41 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:51:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:51:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:47 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:51:48 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:51:49 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:51:49 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:51:49 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=9159MB free_disk=25.11872100830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:51:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:51:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:51:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:51:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:51:51 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:51:51 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:51:51 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:51:54 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:51:56 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:01 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:52:06 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:52:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:52:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:52:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:52:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:52:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:52:11 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:21 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:26 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:27 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:31 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:52:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:52:32 user nova-compute[74587]: DEBUG nova.compute.manager [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:52:33 user nova-compute[74587]: INFO nova.compute.claims [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Claim successful on node user
Oct 18 07:52:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.network.neutron [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:52:33 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.policy [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e01ac2e8606548e688cc3f0b4e580584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a264a057ebaa4ab89e189f918470960b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.compute.manager [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:52:33 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Creating image(s)
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "/opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "/opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "/opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.179s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.183s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk 1073741824" returned: 0 in 0.057s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:52:33 user nova-compute[74587]: DEBUG nova.network.neutron [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Successfully created port: 8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.188s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Cannot resize image /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Ensure instance console log exists: /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.network.neutron [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Successfully updated port: 8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquired lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.network.neutron [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.network.neutron [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-feb2a501-a0ca-4dd1-b6d0-6ec34fbb291a req-f65dcf86-487e-487d-8cf7-6663f93e251c service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received event network-changed-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.compute.manager [req-feb2a501-a0ca-4dd1-b6d0-6ec34fbb291a req-f65dcf86-487e-487d-8cf7-6663f93e251c service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Refreshing instance network info cache due to event network-changed-8a46a5d2-e010-4ed1-aac6-55515e3633e9. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-feb2a501-a0ca-4dd1-b6d0-6ec34fbb291a req-f65dcf86-487e-487d-8cf7-6663f93e251c service nova] Acquiring lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.network.neutron [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating instance_info_cache with network_info: [{"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Releasing lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Instance network_info: |[{"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-feb2a501-a0ca-4dd1-b6d0-6ec34fbb291a req-f65dcf86-487e-487d-8cf7-6663f93e251c service nova] Acquired lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.network.neutron [req-feb2a501-a0ca-4dd1-b6d0-6ec34fbb291a req-f65dcf86-487e-487d-8cf7-6663f93e251c service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Refreshing network info cache for port 8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Start _get_guest_xml network_info=[{"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:52:34 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:52:34 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-994684856',display_name='tempest-TestServerVolumeAttachmentScenario-server-994684856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-994684856',id=51,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFvx2lk/Rmf6eQl1TIktUL9l627ET4XWT0hheLnEZf4gTmzQMeLTGOpExYBjUcQNkjEylSPRZFYVWGYFe4QKL/I2RoKkleZ5aKAMykvzaatx4xmIW9+4V7YeAOUx6b9pw==',key_name='tempest-keypair-532736889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a264a057ebaa4ab89e189f918470960b',ramdisk_id='',reservation_id='r-j3j66pzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-448090876',owner_user_name='tempest-TestServerVolumeAttachmentScenario-448090876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:52:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e01ac2e8606548e688cc3f0b4e580584',uuid=81d95579-4f99-420c-9b76-de0a9b4cfb8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Converting VIF {"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:10:09,bridge_name='br-int',has_traffic_filtering=True,id=8a46a5d2-e010-4ed1-aac6-55515e3633e9,network=Network(dbfa77ab-5238-4d04-a349-faf165bf5efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a46a5d2-e0') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.objects.instance [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lazy-loading 'pci_devices' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:52:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:52:34 user nova-compute[74587]:   <uuid>81d95579-4f99-420c-9b76-de0a9b4cfb8b</uuid>
Oct 18 07:52:34 user nova-compute[74587]:   <name>instance-00000033</name>
Oct 18 07:52:34 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:52:34 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:52:34 user nova-compute[74587]:   <metadata>
Oct 18 07:52:34 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:52:34 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:52:34 user nova-compute[74587]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-994684856</nova:name>
Oct 18 07:52:34 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:52:34</nova:creationTime>
Oct 18 07:52:34 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:52:34 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:52:34 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:52:34 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:52:34 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:52:34 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:52:34 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:52:34 user nova-compute[74587]:       <nova:owner>
Oct 18 07:52:34 user nova-compute[74587]:         <nova:user uuid="e01ac2e8606548e688cc3f0b4e580584">tempest-TestServerVolumeAttachmentScenario-448090876-project-member</nova:user>
Oct 18 07:52:34 user nova-compute[74587]:         <nova:project uuid="a264a057ebaa4ab89e189f918470960b">tempest-TestServerVolumeAttachmentScenario-448090876</nova:project>
Oct 18 07:52:34 user nova-compute[74587]:       </nova:owner>
Oct 18 07:52:34 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:52:34 user nova-compute[74587]:       <nova:ports>
Oct 18 07:52:34 user nova-compute[74587]:         <nova:port uuid="8a46a5d2-e010-4ed1-aac6-55515e3633e9">
Oct 18 07:52:34 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 07:52:34 user nova-compute[74587]:         </nova:port>
Oct 18 07:52:34 user nova-compute[74587]:       </nova:ports>
Oct 18 07:52:34 user nova-compute[74587]:     </nova:instance>
Oct 18 07:52:34 user nova-compute[74587]:   </metadata>
Oct 18 07:52:34 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:52:34 user nova-compute[74587]:     <system>
Oct 18 07:52:34 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:52:34 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:52:34 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:52:34 user nova-compute[74587]:       <entry name="serial">81d95579-4f99-420c-9b76-de0a9b4cfb8b</entry>
Oct 18 07:52:34 user nova-compute[74587]:       <entry name="uuid">81d95579-4f99-420c-9b76-de0a9b4cfb8b</entry>
Oct 18 07:52:34 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:52:34 user nova-compute[74587]:     </system>
Oct 18 07:52:34 user nova-compute[74587]:   </sysinfo>
Oct 18 07:52:34 user nova-compute[74587]:   <os>
Oct 18 07:52:34 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:52:34 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:52:34 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:52:34 user nova-compute[74587]:   </os>
Oct 18 07:52:34 user nova-compute[74587]:   <features>
Oct 18 07:52:34 user nova-compute[74587]:     <acpi/>
Oct 18 07:52:34 user nova-compute[74587]:     <apic/>
Oct 18 07:52:34 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:52:34 user nova-compute[74587]:   </features>
Oct 18 07:52:34 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:52:34 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:52:34 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:52:34 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:52:34 user nova-compute[74587]:   </clock>
Oct 18 07:52:34 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:52:34 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:52:34 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:52:34 user nova-compute[74587]:   </cpu>
Oct 18 07:52:34 user nova-compute[74587]:   <devices>
Oct 18 07:52:34 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:52:34 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:52:34 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk"/>
Oct 18 07:52:34 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:52:34 user nova-compute[74587]:     </disk>
Oct 18 07:52:34 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:52:34 user nova-compute[74587]:       <mac address="fa:16:3e:92:10:09"/>
Oct 18 07:52:34 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:52:34 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:52:34 user nova-compute[74587]:       <target dev="tap8a46a5d2-e0"/>
Oct 18 07:52:34 user nova-compute[74587]:     </interface>
Oct 18 07:52:34 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:52:34 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/console.log" append="off"/>
Oct 18 07:52:34 user nova-compute[74587]:     </serial>
Oct 18 07:52:34 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:52:34 user nova-compute[74587]:     <video>
Oct 18 07:52:34 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:52:34 user nova-compute[74587]:     </video>
Oct 18 07:52:34 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:52:34 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:52:34 user nova-compute[74587]:     </rng>
Oct 18 07:52:34 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:52:34 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:52:34 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:52:34 user nova-compute[74587]:     </memballoon>
Oct 18 07:52:34 user nova-compute[74587]:   </devices>
Oct 18 07:52:34 user nova-compute[74587]: </domain>
Oct 18 07:52:34 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-994684856',display_name='tempest-TestServerVolumeAttachmentScenario-server-994684856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-994684856',id=51,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFvx2lk/Rmf6eQl1TIktUL9l627ET4XWT0hheLnEZf4gTmzQMeLTGOpExYBjUcQNkjEylSPRZFYVWGYFe4QKL/I2RoKkleZ5aKAMykvzaatx4xmIW9+4V7YeAOUx6b9pw==',key_name='tempest-keypair-532736889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a264a057ebaa4ab89e189f918470960b',ramdisk_id='',reservation_id='r-j3j66pzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-448090876',owner_user_name='tempest-TestServerVolumeAttachmentScenario-448090876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:52:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e01ac2e8606548e688cc3f0b4e580584',uuid=81d95579-4f99-420c-9b76-de0a9b4cfb8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Converting VIF {"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:10:09,bridge_name='br-int',has_traffic_filtering=True,id=8a46a5d2-e010-4ed1-aac6-55515e3633e9,network=Network(dbfa77ab-5238-4d04-a349-faf165bf5efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a46a5d2-e0') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG os_vif [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:10:09,bridge_name='br-int',has_traffic_filtering=True,id=8a46a5d2-e010-4ed1-aac6-55515e3633e9,network=Network(dbfa77ab-5238-4d04-a349-faf165bf5efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a46a5d2-e0') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f3bb6c8-fd8c-599f-a4e1-e7a78b747f11', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a46a5d2-e0, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a46a5d2-e0, col_values=(('qos', UUID('53421016-7a00-415f-bc46-2efe78aadfff')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a46a5d2-e0, col_values=(('external_ids', {'iface-id': '8a46a5d2-e010-4ed1-aac6-55515e3633e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:10:09', 'vm-uuid': '81d95579-4f99-420c-9b76-de0a9b4cfb8b'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:35 user nova-compute[74587]: INFO os_vif [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:10:09,bridge_name='br-int',has_traffic_filtering=True,id=8a46a5d2-e010-4ed1-aac6-55515e3633e9,network=Network(dbfa77ab-5238-4d04-a349-faf165bf5efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a46a5d2-e0')
Oct 18 07:52:35 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] No VIF found with MAC fa:16:3e:92:10:09, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG nova.network.neutron [req-feb2a501-a0ca-4dd1-b6d0-6ec34fbb291a req-f65dcf86-487e-487d-8cf7-6663f93e251c service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updated VIF entry in instance network info cache for port 8a46a5d2-e010-4ed1-aac6-55515e3633e9. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG nova.network.neutron [req-feb2a501-a0ca-4dd1-b6d0-6ec34fbb291a req-f65dcf86-487e-487d-8cf7-6663f93e251c service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating instance_info_cache with network_info: [{"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:52:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-feb2a501-a0ca-4dd1-b6d0-6ec34fbb291a req-f65dcf86-487e-487d-8cf7-6663f93e251c service nova] Releasing lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:52:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:36 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-14ff24fb-ab62-4a05-8f33-ef7699cf8281 req-54a0c8ea-07b6-4025-9023-363cf2beb3df service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received event network-vif-plugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:52:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-14ff24fb-ab62-4a05-8f33-ef7699cf8281 req-54a0c8ea-07b6-4025-9023-363cf2beb3df service nova] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:52:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-14ff24fb-ab62-4a05-8f33-ef7699cf8281 req-54a0c8ea-07b6-4025-9023-363cf2beb3df service nova] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:52:36 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-14ff24fb-ab62-4a05-8f33-ef7699cf8281 req-54a0c8ea-07b6-4025-9023-363cf2beb3df service nova] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:52:36 user nova-compute[74587]: DEBUG nova.compute.manager [req-14ff24fb-ab62-4a05-8f33-ef7699cf8281 req-54a0c8ea-07b6-4025-9023-363cf2beb3df service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] No waiting events found dispatching network-vif-plugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:52:36 user nova-compute[74587]: WARNING nova.compute.manager [req-14ff24fb-ab62-4a05-8f33-ef7699cf8281 req-54a0c8ea-07b6-4025-9023-363cf2beb3df service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received unexpected event network-vif-plugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 for instance with vm_state building and task_state spawning.
Oct 18 07:52:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:37 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.compute.manager [req-5c61db3d-9dbf-430f-9ef9-70ffcaa2efcf req-b471017d-40e7-4bff-b5b7-09b144fcc8df service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received event network-vif-plugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5c61db3d-9dbf-430f-9ef9-70ffcaa2efcf req-b471017d-40e7-4bff-b5b7-09b144fcc8df service nova] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5c61db3d-9dbf-430f-9ef9-70ffcaa2efcf req-b471017d-40e7-4bff-b5b7-09b144fcc8df service nova] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-5c61db3d-9dbf-430f-9ef9-70ffcaa2efcf req-b471017d-40e7-4bff-b5b7-09b144fcc8df service nova] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.compute.manager [req-5c61db3d-9dbf-430f-9ef9-70ffcaa2efcf req-b471017d-40e7-4bff-b5b7-09b144fcc8df service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] No waiting events found dispatching network-vif-plugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:52:38 user nova-compute[74587]: WARNING nova.compute.manager [req-5c61db3d-9dbf-430f-9ef9-70ffcaa2efcf req-b471017d-40e7-4bff-b5b7-09b144fcc8df service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received unexpected event network-vif-plugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 for instance with vm_state building and task_state spawning.
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:52:38 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Instance spawned successfully.
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:52:38 user nova-compute[74587]: INFO nova.compute.manager [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Took 5.47 seconds to spawn the instance on the hypervisor.
Oct 18 07:52:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:52:38 user nova-compute[74587]: INFO nova.compute.manager [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Took 6.00 seconds to build instance.
Oct 18 07:52:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-570c96d4-43e9-4ceb-9ece-136ce277baba tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.133s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:52:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:52:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:48 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating instance_info_cache with network_info: [{"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:52:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:52:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:50 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:52:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:52:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:52:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:52:50 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:52:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:52:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:52:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:52:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:52:51 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:52:51 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:52:51 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=25.115596771240234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:52:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:52:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:52:51 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:52:51 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:52:51 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:52:51 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:52:51 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:52:51 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:52:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:52:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:53 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:52:53 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:52:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:52:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:52:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:53:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:53:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:53:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:53:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:53:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:53:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:53:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:53:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:53:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:53:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:53:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:53:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:46 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:53:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:53:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:53:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:53:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:53:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:53:49 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:53:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating instance_info_cache with network_info: [{"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:53:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:53:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:53:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:53:50 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:51 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:51 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:53:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:53:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:53:51 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:53:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:53:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:53:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:53:51 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:53:52 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:53:52 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=25.08725357055664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:53:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:53:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:53:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:53:57 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:54:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:54:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:54:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:54:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:54:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:54:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:54:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:54:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:54:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:54:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:54:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:54:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:54:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-4989413d-830d-451c-92ed-9b0f8d6db690 req-ce43fcf6-e514-4231-a565-0e873d68e1b7 service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received event network-changed-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:54:23 user nova-compute[74587]: DEBUG nova.compute.manager [req-4989413d-830d-451c-92ed-9b0f8d6db690 req-ce43fcf6-e514-4231-a565-0e873d68e1b7 service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Refreshing instance network info cache due to event network-changed-8a46a5d2-e010-4ed1-aac6-55515e3633e9. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:54:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4989413d-830d-451c-92ed-9b0f8d6db690 req-ce43fcf6-e514-4231-a565-0e873d68e1b7 service nova] Acquiring lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:54:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4989413d-830d-451c-92ed-9b0f8d6db690 req-ce43fcf6-e514-4231-a565-0e873d68e1b7 service nova] Acquired lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:54:23 user nova-compute[74587]: DEBUG nova.network.neutron [req-4989413d-830d-451c-92ed-9b0f8d6db690 req-ce43fcf6-e514-4231-a565-0e873d68e1b7 service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Refreshing network info cache for port 8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:54:24 user nova-compute[74587]: DEBUG nova.network.neutron [req-4989413d-830d-451c-92ed-9b0f8d6db690 req-ce43fcf6-e514-4231-a565-0e873d68e1b7 service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updated VIF entry in instance network info cache for port 8a46a5d2-e010-4ed1-aac6-55515e3633e9. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:54:24 user nova-compute[74587]: DEBUG nova.network.neutron [req-4989413d-830d-451c-92ed-9b0f8d6db690 req-ce43fcf6-e514-4231-a565-0e873d68e1b7 service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating instance_info_cache with network_info: [{"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:54:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-4989413d-830d-451c-92ed-9b0f8d6db690 req-ce43fcf6-e514-4231-a565-0e873d68e1b7 service nova] Releasing lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lazy-loading 'flavor' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:54:25 user nova-compute[74587]: INFO nova.compute.manager [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Attaching volume 99265e3f-aba5-4a1b-8338-02413c802662 to /dev/vdb
Oct 18 07:54:25 user nova-compute[74587]: DEBUG os_brick.utils [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f77766-c878-465b-baf3-acfb7f34df8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede07bb1-2b57-4166-938e-ae03449e3d77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b24337-2016-4f5f-855d-daef952846d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf62cf4-b64c-4398-8575-97ed4f1ac5f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:54:25 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:54:25 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[502f27e6-9b1c-4dd9-be65-731f91bd61d0]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG os_brick.utils [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:54:25 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating existing volume attachment record: a3e30fd6-386b-4e29-9b5b-ca2892673c34 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:54:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:34 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:34 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 07:54:34 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:54:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:54:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:44 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:54:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:54:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:54:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:54:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:54:49 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:54:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating instance_info_cache with network_info: [{"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:54:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:54:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alrXIOVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:54:50 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:54:50 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:54:50 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a73a67-11a3-4b0b-b7fa-8ee94a84e185]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:54:50 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f6277-439e-4cc0-9741-353163613345]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662] added
Oct 18 07:54:50 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9019b6-e467-4cd6-aeb3-70cbb6589b47]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a3be63-6b91-47f6-a8fa-1d3f2cf7ce01]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v alrXIOVZ {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v alrXIOVZ" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[968daa8b-5b38-4193-a9d2-5849c5749de3]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'alrXIOVZ'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[282cc5d6-5f96-447b-8d43-ea0a08cce68a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a5c80-3890-4ea4-b815-6ae9432bc02e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:54:50 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 07:54:50 user nova-compute[74587]:  {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:54:50 user nova-compute[74587]: WARNING os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 07:54:50 user nova-compute[74587]: 
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b30e4be-cff1-4ae0-9b18-b52ef561be5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662, portal: 172.16.0.220,3260]
Oct 18 07:54:50 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662, portal: 172.16.0.220,3260] successful.
Oct 18 07:54:50 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[812f4d5a-c138-4b76-80b5-7683f13ee6c1]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[096ccde3-38f8-457f-9b0a-c997069b3cec]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)
Oct 18 07:54:50 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)
Oct 18 07:54:50 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7990e63d-a84b-4239-83c8-36f8e43e1e6e]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:54:50 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alrXIOVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:54:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:54:51 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23633316237313335', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:54:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633316237313335', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:54:51 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lazy-loading 'flavor' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:54:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:54:51 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:54:51 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:54:51 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:54:51 user nova-compute[74587]:   <serial>99265e3f-aba5-4a1b-8338-02413c802662</serial>
Oct 18 07:54:51 user nova-compute[74587]: </disk>
Oct 18 07:54:51 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:54:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:54:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:54:51 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] No VIF found with MAC fa:16:3e:92:10:09, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c5ea7423-f7c7-4c14-8317-21ea525fe33c tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.325s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.443s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:54:53 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:54:53 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:54:53 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=25.086280822753906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:54:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:54:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:54:53 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:54:53 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:54:53 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:54:53 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:54:53 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:54:53 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:54:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:54:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:54:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:54:54 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lazy-loading 'flavor' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:54:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:54:55 user nova-compute[74587]: INFO nova.compute.manager [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Attaching volume 18462474-969e-49c6-ae4b-c25670a56ecb to /dev/vdc
Oct 18 07:54:55 user nova-compute[74587]: DEBUG os_brick.utils [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6224a8f-f6bc-4aba-960f-19b9a50404ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac17f984-ce53-46b7-b0af-258e5392ce6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f1486d-25bb-43db-b206-e29b65683ecb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dbf612-3482-4f3f-9fc3-9ae64387d5a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 07:54:55 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adea933-1889-43b4-bd1d-3d95ba6a480d]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG os_brick.utils [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating existing volume attachment record: a26eda2c-1988-4062-91ce-fa943cc17410 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 07:54:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:54:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:54:58 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:55:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:55:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:55:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:55:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:55:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:55:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:55:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:55:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLlzYcmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:55:11 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:55:11 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:55:11 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0423c1-9ec7-4ce9-b5fc-d4869f8b3273]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 07:55:11 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dcb395-7ab5-4faf-aafb-c1dab0aedbb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb] added
Oct 18 07:55:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[63378d2d-bf66-40bd-815a-3eda52a38a6f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf64a82b-05b5-4983-8ce0-9cdb78d0757e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLlzYcmg {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLlzYcmg" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af53b8b-355b-4819-b45c-f1544b431611]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uLlzYcmg'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef58a712-44e4-4ea9-a23f-8d7987b4403e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7918432-d8df-4a54-ac84-6536c1d6febf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)
Oct 18 07:55:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)
Oct 18 07:55:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a13c0-9349-4c59-8364-ad2482a7d760]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb, portal: 172.16.0.220,3260]
Oct 18 07:55:11 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb, portal: 172.16.0.220,3260] successful.
Oct 18 07:55:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c1ee94-6201-4011-813e-96610a1b2ec8]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c27c286-9ffd-40db-8c63-f7a048185988]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)
Oct 18 07:55:11 user nova-compute[74587]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb (non-flash)
Oct 18 07:55:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)
Oct 18 07:55:11 user nova-compute[74587]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb (non-flash)
Oct 18 07:55:11 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c4ed56-984f-4512-9f6d-66af6167b143]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 07:55:11 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLlzYcmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 07:55:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:55:12 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26164363938643665', 'path': '/dev/sdc'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:55:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164363938643665', 'path': '/dev/sdc'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 07:55:12 user nova-compute[74587]: DEBUG nova.objects.instance [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lazy-loading 'flavor' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:55:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 07:55:12 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:55:12 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:55:12 user nova-compute[74587]:   <target dev="vdc" bus="virtio"/>
Oct 18 07:55:12 user nova-compute[74587]:   <serial>18462474-969e-49c6-ae4b-c25670a56ecb</serial>
Oct 18 07:55:12 user nova-compute[74587]: </disk>
Oct 18 07:55:12 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 07:55:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:55:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:55:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:55:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] No VIF found with MAC fa:16:3e:92:10:09, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:55:12 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-3a41e1d6-5879-42ab-8769-9a5ffc12b8b6 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.840s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:55:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:55:13 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:55:13 user nova-compute[74587]: INFO nova.compute.manager [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Detaching volume 18462474-969e-49c6-ae4b-c25670a56ecb
Oct 18 07:55:13 user nova-compute[74587]: INFO nova.virt.block_device [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Attempting to driver detach volume 18462474-969e-49c6-ae4b-c25670a56ecb from mountpoint /dev/vdc
Oct 18 07:55:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Attempting to detach device vdc from instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:55:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:55:13 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:55:13 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:55:13 user nova-compute[74587]:   <target dev="vdc" bus="virtio"/>
Oct 18 07:55:13 user nova-compute[74587]:   <serial>18462474-969e-49c6-ae4b-c25670a56ecb</serial>
Oct 18 07:55:13 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 07:55:13 user nova-compute[74587]: </disk>
Oct 18 07:55:13 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:55:13 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Successfully detached device vdc from instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b from the persistent domain config.
Oct 18 07:55:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:55:13 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:55:13 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:55:13 user nova-compute[74587]:   <source dev="/dev/sdc"/>
Oct 18 07:55:13 user nova-compute[74587]:   <target dev="vdc" bus="virtio"/>
Oct 18 07:55:13 user nova-compute[74587]:   <serial>18462474-969e-49c6-ae4b-c25670a56ecb</serial>
Oct 18 07:55:13 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 07:55:13 user nova-compute[74587]: </disk>
Oct 18 07:55:13 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:55:14 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:55:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:55:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:55:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:55:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:55:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:55:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:55:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:55:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:55:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:55:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:55:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:55:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:55:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:55:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:55:34 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b is timed out.
Oct 18 07:55:34 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Successfully detached device vdc from instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b from the live domain config.
Oct 18 07:55:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLlzYcmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:55:34 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcb18a7-8539-4be2-a854-6499dc021348]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:55:34 user nova-compute[74587]: No targets found.
Oct 18 07:55:34 user nova-compute[74587]: iSNS:
Oct 18 07:55:34 user nova-compute[74587]: No targets found.
Oct 18 07:55:34 user nova-compute[74587]: STATIC:
Oct 18 07:55:34 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662
Oct 18 07:55:34 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:55:34 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:55:34 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb
Oct 18 07:55:34 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:55:34 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:55:34 user nova-compute[74587]: FIRMWARE:
Oct 18 07:55:34 user nova-compute[74587]: No targets found.
Oct 18 07:55:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:55:34 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:55:34 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e98382d-2d63-417b-bc13-7dab852db436]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44187ff-e12a-402d-afbc-9bb2b0fd20d8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)
Oct 18 07:55:34 user nova-compute[74587]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb (non-flash)
Oct 18 07:55:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)
Oct 18 07:55:34 user nova-compute[74587]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb (non-flash)
Oct 18 07:55:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1008455a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb'): ({'sdc'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Removing single pathed devices sdc {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6bab0c-3577-4992-a8f1-a3c0dafa7dcd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb0a946-8a2b-49bd-9cda-c4eb3ee7ae72]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Flushing IO for device /dev/sdc {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25d5032-be87-4b7f-9c6e-9cda703ea4da]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b4f251-ef55-41c5-b9d7-2497d68dcc77]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] SCSI volumes sdc have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0658a76-0bd7-4133-98ca-bc3f468ef6e6]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9093a4ad-2370-406f-884a-74884803f878]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb, portal: 172.16.0.220,3260]
Oct 18 07:55:34 user nova-compute[74587]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb, portal: 172.16.0.220,3260] successful.
Oct 18 07:55:34 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18462474-969e-49c6-ae4b-c25670a56ecb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[069077c6-d3a7-42b5-aab4-ed378e09d54b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] <== disconnect_volume: return (302ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:55:34 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:55:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:55:35 user nova-compute[74587]: DEBUG nova.objects.instance [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lazy-loading 'flavor' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:55:35 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-57fe5d24-5587-4ee2-b1dd-e47e2cd91516 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:55:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:55:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:55:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:55:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:55:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating instance_info_cache with network_info: [{"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:55:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:55:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:55:52 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:55:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:55:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:55:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:55:52 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:55:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:55:52 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:55:52 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 07:55:53 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:55:53 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:55:53 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=25.085071563720703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:55:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:55:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:55:53 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:55:53 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:55:53 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:55:53 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:55:53 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:55:53 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:55:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:55:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:55:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:55:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:55:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:55:57 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:56:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:56:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:56:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:56:04 user nova-compute[74587]: INFO nova.compute.manager [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Detaching volume 99265e3f-aba5-4a1b-8338-02413c802662
Oct 18 07:56:04 user nova-compute[74587]: INFO nova.virt.block_device [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Attempting to driver detach volume 99265e3f-aba5-4a1b-8338-02413c802662 from mountpoint /dev/vdb
Oct 18 07:56:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Attempting to detach device vdb from instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 07:56:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:56:04 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:56:04 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:56:04 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:56:04 user nova-compute[74587]:   <serial>99265e3f-aba5-4a1b-8338-02413c802662</serial>
Oct 18 07:56:04 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:56:04 user nova-compute[74587]: </disk>
Oct 18 07:56:04 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:56:04 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Successfully detached device vdb from instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b from the persistent domain config.
Oct 18 07:56:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 07:56:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 07:56:04 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 07:56:04 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 07:56:04 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 07:56:04 user nova-compute[74587]:   <serial>99265e3f-aba5-4a1b-8338-02413c802662</serial>
Oct 18 07:56:04 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 07:56:04 user nova-compute[74587]: </disk>
Oct 18 07:56:04 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 07:56:04 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 07:56:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:56:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:56:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:56:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:56:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:56:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:24 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b is timed out.
Oct 18 07:56:24 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Successfully detached device vdb from instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b from the live domain config.
Oct 18 07:56:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alrXIOVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 07:56:24 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5a1894-a418-4464-980d-6aeef4f4c98f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 07:56:24 user nova-compute[74587]: No targets found.
Oct 18 07:56:24 user nova-compute[74587]: iSNS:
Oct 18 07:56:24 user nova-compute[74587]: No targets found.
Oct 18 07:56:24 user nova-compute[74587]: STATIC:
Oct 18 07:56:24 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662
Oct 18 07:56:24 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 07:56:24 user nova-compute[74587]:                 Iface Name: default
Oct 18 07:56:24 user nova-compute[74587]: FIRMWARE:
Oct 18 07:56:24 user nova-compute[74587]: No targets found.
Oct 18 07:56:24 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 07:56:24 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 07:56:24 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8787c1f-ee34-46a0-adbc-0a84a3e521df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[670304a0-766f-48d5-89e8-7846288df96c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)
Oct 18 07:56:24 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 (non-flash)
Oct 18 07:56:24 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe45197e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe304f-b636-4ed8-9c84-604f4a89018a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[704ecb23-e352-4ea7-b4f4-0f13d76149ad]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f026b10-8540-42c1-8e71-e02bdacfd7ef]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc372eb-e102-45a6-9471-3e0ba0b72082]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[501975b5-4ebc-4bfc-af05-ea647d01ad01]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[89610723-a28b-4a36-89f9-0771a71e50e0]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662, portal: 172.16.0.220,3260]
Oct 18 07:56:24 user nova-compute[74587]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662, portal: 172.16.0.220,3260] successful.
Oct 18 07:56:24 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99265e3f-aba5-4a1b-8338-02413c802662 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f332025-b8ac-4e37-bf93-10c1fb3112d1]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] <== disconnect_volume: return (273ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 07:56:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 07:56:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:56:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:56:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:56:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:56:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:25 user nova-compute[74587]: DEBUG nova.objects.instance [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lazy-loading 'flavor' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:56:25 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-639fa60e-d25b-44dc-bbfe-8064ebf26919 tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.678s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:56:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:56:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:56:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:56:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:56:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:56:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:56:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:56:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:56:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:56:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:56:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:56:49 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:56:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating instance_info_cache with network_info: [{"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:56:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-81d95579-4f99-420c-9b76-de0a9b4cfb8b" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:56:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:56:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:56:54 user nova-compute[74587]: INFO nova.compute.manager [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Terminating instance
Oct 18 07:56:54 user nova-compute[74587]: DEBUG nova.compute.manager [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:54 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.compute.manager [req-c390f05d-31da-4d5a-ae14-8c95941a9def req-6056e325-d86b-4688-8918-109e62e649fd service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received event network-vif-unplugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c390f05d-31da-4d5a-ae14-8c95941a9def req-6056e325-d86b-4688-8918-109e62e649fd service nova] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c390f05d-31da-4d5a-ae14-8c95941a9def req-6056e325-d86b-4688-8918-109e62e649fd service nova] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c390f05d-31da-4d5a-ae14-8c95941a9def req-6056e325-d86b-4688-8918-109e62e649fd service nova] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.compute.manager [req-c390f05d-31da-4d5a-ae14-8c95941a9def req-6056e325-d86b-4688-8918-109e62e649fd service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] No waiting events found dispatching network-vif-unplugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.compute.manager [req-c390f05d-31da-4d5a-ae14-8c95941a9def req-6056e325-d86b-4688-8918-109e62e649fd service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received event network-vif-unplugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 07:56:55 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Instance destroyed successfully.
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.objects.instance [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lazy-loading 'resources' on Instance uuid 81d95579-4f99-420c-9b76-de0a9b4cfb8b {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:56:55 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:56:55 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8996MB free_disk=25.084392547607422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-994684856',display_name='tempest-TestServerVolumeAttachmentScenario-server-994684856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-994684856',id=51,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFvx2lk/Rmf6eQl1TIktUL9l627ET4XWT0hheLnEZf4gTmzQMeLTGOpExYBjUcQNkjEylSPRZFYVWGYFe4QKL/I2RoKkleZ5aKAMykvzaatx4xmIW9+4V7YeAOUx6b9pw==',key_name='tempest-keypair-532736889',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:52:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a264a057ebaa4ab89e189f918470960b',ramdisk_id='',reservation_id='r-j3j66pzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-448090876',owner_user_name='tempest-TestServerVolumeAttachmentScenario-448090876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e01ac2e8606548e688cc3f0b4e580584',uuid=81d95579-4f99-420c-9b76-de0a9b4cfb8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Converting VIF {"id": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "address": "fa:16:3e:92:10:09", "network": {"id": "dbfa77ab-5238-4d04-a349-faf165bf5efc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1788823895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a264a057ebaa4ab89e189f918470960b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a46a5d2-e0", "ovs_interfaceid": "8a46a5d2-e010-4ed1-aac6-55515e3633e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:10:09,bridge_name='br-int',has_traffic_filtering=True,id=8a46a5d2-e010-4ed1-aac6-55515e3633e9,network=Network(dbfa77ab-5238-4d04-a349-faf165bf5efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a46a5d2-e0') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG os_vif [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:10:09,bridge_name='br-int',has_traffic_filtering=True,id=8a46a5d2-e010-4ed1-aac6-55515e3633e9,network=Network(dbfa77ab-5238-4d04-a349-faf165bf5efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a46a5d2-e0') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a46a5d2-e0, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53421016-7a00-415f-bc46-2efe78aadfff) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:56:55 user nova-compute[74587]: INFO os_vif [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:10:09,bridge_name='br-int',has_traffic_filtering=True,id=8a46a5d2-e010-4ed1-aac6-55515e3633e9,network=Network(dbfa77ab-5238-4d04-a349-faf165bf5efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a46a5d2-e0')
Oct 18 07:56:55 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Deleting instance files /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b_del
Oct 18 07:56:55 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Deletion of /opt/stack/data/nova/instances/81d95579-4f99-420c-9b76-de0a9b4cfb8b_del complete
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:56:55 user nova-compute[74587]: INFO nova.compute.manager [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 18 07:56:55 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:56:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:56:56 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Took 0.61 seconds to deallocate network for instance.
Oct 18 07:56:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:56:56 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Deleted allocations for instance 81d95579-4f99-420c-9b76-de0a9b4cfb8b
Oct 18 07:56:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-23397ad6-f018-46ed-bfd7-8e94fcf5dfcb tempest-TestServerVolumeAttachmentScenario-448090876 tempest-TestServerVolumeAttachmentScenario-448090876-project-member] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-42ee4f33-9496-416d-b09b-ff21a4b28afd req-729cf203-e7e3-4fa9-9309-f56e52c7eabd service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received event network-vif-plugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-42ee4f33-9496-416d-b09b-ff21a4b28afd req-729cf203-e7e3-4fa9-9309-f56e52c7eabd service nova] Acquiring lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-42ee4f33-9496-416d-b09b-ff21a4b28afd req-729cf203-e7e3-4fa9-9309-f56e52c7eabd service nova] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-42ee4f33-9496-416d-b09b-ff21a4b28afd req-729cf203-e7e3-4fa9-9309-f56e52c7eabd service nova] Lock "81d95579-4f99-420c-9b76-de0a9b4cfb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:56:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-42ee4f33-9496-416d-b09b-ff21a4b28afd req-729cf203-e7e3-4fa9-9309-f56e52c7eabd service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] No waiting events found dispatching network-vif-plugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:56:56 user nova-compute[74587]: WARNING nova.compute.manager [req-42ee4f33-9496-416d-b09b-ff21a4b28afd req-729cf203-e7e3-4fa9-9309-f56e52c7eabd service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received unexpected event network-vif-plugged-8a46a5d2-e010-4ed1-aac6-55515e3633e9 for instance with vm_state deleted and task_state None.
Oct 18 07:56:56 user nova-compute[74587]: DEBUG nova.compute.manager [req-42ee4f33-9496-416d-b09b-ff21a4b28afd req-729cf203-e7e3-4fa9-9309-f56e52c7eabd service nova] [instance: 81d95579-4f99-420c-9b76-de0a9b4cfb8b] Received event network-vif-deleted-8a46a5d2-e010-4ed1-aac6-55515e3633e9 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:56:58 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:57:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:57:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:57:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:57:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:57:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:57:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:57:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:57:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:57:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:57:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:40 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:57:40 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:57:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:46 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:57:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:57:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:57:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:57:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:57:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 07:57:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:57:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:57:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:57:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:57:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:57:56 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:57:56 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:57:56 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=9136MB free_disk=25.111495971679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:57:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:57:57 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:57:57 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:57:58 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:58:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:58:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:58:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:14 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:16 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:22 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Starting instance... {{(pid=74587) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74587) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 07:58:26 user nova-compute[74587]: INFO nova.compute.claims [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Claim successful on node user
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Start building networks asynchronously for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Allocating IP information in the background. {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] allocate_for_instance() {{(pid=74587) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 07:58:26 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Start building block device mappings for instance. {{(pid=74587) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.policy [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3065922317434d8b88e912f35a026fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912259b5c6c4446aa7669ccd59265bd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74587) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Start spawning the instance on the hypervisor. {{(pid=74587) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Creating instance directory {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 07:58:26 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Creating image(s)
Oct 18 07:58:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "/opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "/opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "/opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:58:26 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.165s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a7713629c387e365b08db744a4455b1e092b0e76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.169s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk 1073741824 {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76,backing_fmt=raw /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk 1073741824" returned: 0 in 0.046s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a7713629c387e365b08db744a4455b1e092b0e76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7713629c387e365b08db744a4455b1e092b0e76 --force-share --output=json" returned: 0 in 0.172s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk. size=1073741824 {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Successfully created port: 70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG nova.virt.disk.api [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Cannot resize image /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk to a smaller size. {{(pid=74587) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Created local disks {{(pid=74587) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Ensure instance console log exists: /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/console.log {{(pid=74587) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:58:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Successfully updated port: 70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Building network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Instance cache missing network info. {{(pid=74587) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-46ce89ef-901a-434e-a191-3f3eeed391df req-4f940cf9-0b4a-405e-990a-ca8bea03976f service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received event network-changed-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.compute.manager [req-46ce89ef-901a-434e-a191-3f3eeed391df req-4f940cf9-0b4a-405e-990a-ca8bea03976f service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Refreshing instance network info cache due to event network-changed-70ad2896-ff04-464f-b56b-104f49e39c14. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-46ce89ef-901a-434e-a191-3f3eeed391df req-4f940cf9-0b4a-405e-990a-ca8bea03976f service nova] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.neutron [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Instance network_info: |[{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74587) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-46ce89ef-901a-434e-a191-3f3eeed391df req-4f940cf9-0b4a-405e-990a-ca8bea03976f service nova] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-46ce89ef-901a-434e-a191-3f3eeed391df req-4f940cf9-0b4a-405e-990a-ca8bea03976f service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Refreshing network info cache for port 70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Start _get_guest_xml network_info=[{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '9442f4c2-6355-454c-90aa-9dccf102d343'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 07:58:28 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:58:28 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] CPU controller missing on host. {{(pid=74587) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.host [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] CPU controller found on host. {{(pid=74587) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74587) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T07:03:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T07:03:29Z,direct_url=<?>,disk_format='qcow2',id=9442f4c2-6355-454c-90aa-9dccf102d343,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='21b75bb9de7244cb832931a64959110d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T07:03:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Flavor limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Image limits 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Flavor pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Image pref 0:0:0 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Got 1 possible topologies {{(pid=74587) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.hardware [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74587) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1952977357',display_name='tempest-SnapshotDataIntegrityTests-server-1952977357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1952977357',id=52,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEkxVwjh+BGgrb7vxNx1JUbc2z1FrbrjDU/s4r1v656853if5aovLj/QrhEPWrm+0koWWk7iyQv5hX0Iem3kZiS0MVZaqzj5MgeClnd5Q+OsRlEnkIjMVAqS5GwXvIyxg==',key_name='tempest-keypair-1301779139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912259b5c6c4446aa7669ccd59265bd1',ramdisk_id='',reservation_id='r-bj0k09mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-399313967',owner_user_name='tempest-SnapshotDataIntegrityTests-399313967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3065922317434d8b88e912f35a026fd1',uuid=a027c05d-1121-43fe-9d64-6c8b9418d426,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74587) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Converting VIF {"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3c:4e,bridge_name='br-int',has_traffic_filtering=True,id=70ad2896-ff04-464f-b56b-104f49e39c14,network=Network(ed7a3bf7-ccc0-469d-b725-1db99574beb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ad2896-ff') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.objects.instance [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'pci_devices' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] End _get_guest_xml xml=<domain type="kvm">
Oct 18 07:58:28 user nova-compute[74587]:   <uuid>a027c05d-1121-43fe-9d64-6c8b9418d426</uuid>
Oct 18 07:58:28 user nova-compute[74587]:   <name>instance-00000034</name>
Oct 18 07:58:28 user nova-compute[74587]:   <memory>524288</memory>
Oct 18 07:58:28 user nova-compute[74587]:   <vcpu>1</vcpu>
Oct 18 07:58:28 user nova-compute[74587]:   <metadata>
Oct 18 07:58:28 user nova-compute[74587]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 07:58:28 user nova-compute[74587]:       <nova:package version="0.0.0"/>
Oct 18 07:58:28 user nova-compute[74587]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1952977357</nova:name>
Oct 18 07:58:28 user nova-compute[74587]:       <nova:creationTime>2023-10-18 07:58:28</nova:creationTime>
Oct 18 07:58:28 user nova-compute[74587]:       <nova:flavor name="m1.tiny">
Oct 18 07:58:28 user nova-compute[74587]:         <nova:memory>512</nova:memory>
Oct 18 07:58:28 user nova-compute[74587]:         <nova:disk>1</nova:disk>
Oct 18 07:58:28 user nova-compute[74587]:         <nova:swap>0</nova:swap>
Oct 18 07:58:28 user nova-compute[74587]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 07:58:28 user nova-compute[74587]:         <nova:vcpus>1</nova:vcpus>
Oct 18 07:58:28 user nova-compute[74587]:       </nova:flavor>
Oct 18 07:58:28 user nova-compute[74587]:       <nova:owner>
Oct 18 07:58:28 user nova-compute[74587]:         <nova:user uuid="3065922317434d8b88e912f35a026fd1">tempest-SnapshotDataIntegrityTests-399313967-project-member</nova:user>
Oct 18 07:58:28 user nova-compute[74587]:         <nova:project uuid="912259b5c6c4446aa7669ccd59265bd1">tempest-SnapshotDataIntegrityTests-399313967</nova:project>
Oct 18 07:58:28 user nova-compute[74587]:       </nova:owner>
Oct 18 07:58:28 user nova-compute[74587]:       <nova:root type="image" uuid="9442f4c2-6355-454c-90aa-9dccf102d343"/>
Oct 18 07:58:28 user nova-compute[74587]:       <nova:ports>
Oct 18 07:58:28 user nova-compute[74587]:         <nova:port uuid="70ad2896-ff04-464f-b56b-104f49e39c14">
Oct 18 07:58:28 user nova-compute[74587]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 07:58:28 user nova-compute[74587]:         </nova:port>
Oct 18 07:58:28 user nova-compute[74587]:       </nova:ports>
Oct 18 07:58:28 user nova-compute[74587]:     </nova:instance>
Oct 18 07:58:28 user nova-compute[74587]:   </metadata>
Oct 18 07:58:28 user nova-compute[74587]:   <sysinfo type="smbios">
Oct 18 07:58:28 user nova-compute[74587]:     <system>
Oct 18 07:58:28 user nova-compute[74587]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 07:58:28 user nova-compute[74587]:       <entry name="product">OpenStack Nova</entry>
Oct 18 07:58:28 user nova-compute[74587]:       <entry name="version">0.0.0</entry>
Oct 18 07:58:28 user nova-compute[74587]:       <entry name="serial">a027c05d-1121-43fe-9d64-6c8b9418d426</entry>
Oct 18 07:58:28 user nova-compute[74587]:       <entry name="uuid">a027c05d-1121-43fe-9d64-6c8b9418d426</entry>
Oct 18 07:58:28 user nova-compute[74587]:       <entry name="family">Virtual Machine</entry>
Oct 18 07:58:28 user nova-compute[74587]:     </system>
Oct 18 07:58:28 user nova-compute[74587]:   </sysinfo>
Oct 18 07:58:28 user nova-compute[74587]:   <os>
Oct 18 07:58:28 user nova-compute[74587]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 07:58:28 user nova-compute[74587]:     <boot dev="hd"/>
Oct 18 07:58:28 user nova-compute[74587]:     <smbios mode="sysinfo"/>
Oct 18 07:58:28 user nova-compute[74587]:   </os>
Oct 18 07:58:28 user nova-compute[74587]:   <features>
Oct 18 07:58:28 user nova-compute[74587]:     <acpi/>
Oct 18 07:58:28 user nova-compute[74587]:     <apic/>
Oct 18 07:58:28 user nova-compute[74587]:     <vmcoreinfo/>
Oct 18 07:58:28 user nova-compute[74587]:   </features>
Oct 18 07:58:28 user nova-compute[74587]:   <clock offset="utc">
Oct 18 07:58:28 user nova-compute[74587]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 07:58:28 user nova-compute[74587]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 07:58:28 user nova-compute[74587]:     <timer name="hpet" present="no"/>
Oct 18 07:58:28 user nova-compute[74587]:   </clock>
Oct 18 07:58:28 user nova-compute[74587]:   <cpu mode="custom" match="exact">
Oct 18 07:58:28 user nova-compute[74587]:     <model>Nehalem</model>
Oct 18 07:58:28 user nova-compute[74587]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 07:58:28 user nova-compute[74587]:   </cpu>
Oct 18 07:58:28 user nova-compute[74587]:   <devices>
Oct 18 07:58:28 user nova-compute[74587]:     <disk type="file" device="disk">
Oct 18 07:58:28 user nova-compute[74587]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 07:58:28 user nova-compute[74587]:       <source file="/opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk"/>
Oct 18 07:58:28 user nova-compute[74587]:       <target dev="vda" bus="virtio"/>
Oct 18 07:58:28 user nova-compute[74587]:     </disk>
Oct 18 07:58:28 user nova-compute[74587]:     <interface type="ethernet">
Oct 18 07:58:28 user nova-compute[74587]:       <mac address="fa:16:3e:2d:3c:4e"/>
Oct 18 07:58:28 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:58:28 user nova-compute[74587]:       <mtu size="1442"/>
Oct 18 07:58:28 user nova-compute[74587]:       <target dev="tap70ad2896-ff"/>
Oct 18 07:58:28 user nova-compute[74587]:     </interface>
Oct 18 07:58:28 user nova-compute[74587]:     <serial type="pty">
Oct 18 07:58:28 user nova-compute[74587]:       <log file="/opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/console.log" append="off"/>
Oct 18 07:58:28 user nova-compute[74587]:     </serial>
Oct 18 07:58:28 user nova-compute[74587]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 07:58:28 user nova-compute[74587]:     <video>
Oct 18 07:58:28 user nova-compute[74587]:       <model type="virtio"/>
Oct 18 07:58:28 user nova-compute[74587]:     </video>
Oct 18 07:58:28 user nova-compute[74587]:     <rng model="virtio">
Oct 18 07:58:28 user nova-compute[74587]:       <backend model="random">/dev/urandom</backend>
Oct 18 07:58:28 user nova-compute[74587]:     </rng>
Oct 18 07:58:28 user nova-compute[74587]:     <controller type="usb" index="0" model="none"/>
Oct 18 07:58:28 user nova-compute[74587]:     <memballoon model="virtio">
Oct 18 07:58:28 user nova-compute[74587]:       <stats period="10"/>
Oct 18 07:58:28 user nova-compute[74587]:     </memballoon>
Oct 18 07:58:28 user nova-compute[74587]:   </devices>
Oct 18 07:58:28 user nova-compute[74587]: </domain>
Oct 18 07:58:28 user nova-compute[74587]:  {{(pid=74587) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1952977357',display_name='tempest-SnapshotDataIntegrityTests-server-1952977357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1952977357',id=52,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEkxVwjh+BGgrb7vxNx1JUbc2z1FrbrjDU/s4r1v656853if5aovLj/QrhEPWrm+0koWWk7iyQv5hX0Iem3kZiS0MVZaqzj5MgeClnd5Q+OsRlEnkIjMVAqS5GwXvIyxg==',key_name='tempest-keypair-1301779139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912259b5c6c4446aa7669ccd59265bd1',ramdisk_id='',reservation_id='r-bj0k09mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-399313967',owner_user_name='tempest-SnapshotDataIntegrityTests-399313967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T07:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3065922317434d8b88e912f35a026fd1',uuid=a027c05d-1121-43fe-9d64-6c8b9418d426,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Converting VIF {"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3c:4e,bridge_name='br-int',has_traffic_filtering=True,id=70ad2896-ff04-464f-b56b-104f49e39c14,network=Network(ed7a3bf7-ccc0-469d-b725-1db99574beb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ad2896-ff') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG os_vif [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3c:4e,bridge_name='br-int',has_traffic_filtering=True,id=70ad2896-ff04-464f-b56b-104f49e39c14,network=Network(ed7a3bf7-ccc0-469d-b725-1db99574beb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ad2896-ff') {{(pid=74587) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18c58609-a744-51cc-a1da-6418792bb922', '_type': 'linux-noop'}}, row=False) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70ad2896-ff, may_exist=True, interface_attrs={}) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70ad2896-ff, col_values=(('qos', UUID('30329685-1648-4cf8-b0da-519a147b9b33')),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70ad2896-ff, col_values=(('external_ids', {'iface-id': '70ad2896-ff04-464f-b56b-104f49e39c14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:3c:4e', 'vm-uuid': 'a027c05d-1121-43fe-9d64-6c8b9418d426'}),), if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:28 user nova-compute[74587]: INFO os_vif [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3c:4e,bridge_name='br-int',has_traffic_filtering=True,id=70ad2896-ff04-464f-b56b-104f49e39c14,network=Network(ed7a3bf7-ccc0-469d-b725-1db99574beb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ad2896-ff')
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No VIF found with MAC fa:16:3e:2d:3c:4e, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-46ce89ef-901a-434e-a191-3f3eeed391df req-4f940cf9-0b4a-405e-990a-ca8bea03976f service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updated VIF entry in instance network info cache for port 70ad2896-ff04-464f-b56b-104f49e39c14. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG nova.network.neutron [req-46ce89ef-901a-434e-a191-3f3eeed391df req-4f940cf9-0b4a-405e-990a-ca8bea03976f service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:58:28 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-46ce89ef-901a-434e-a191-3f3eeed391df req-4f940cf9-0b4a-405e-990a-ca8bea03976f service nova] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:58:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:29 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-e6dfee3c-0013-40fa-aa8d-3111760696ff req-fe517615-df22-4640-8a8a-41e62470dd90 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received event network-vif-plugged-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:58:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e6dfee3c-0013-40fa-aa8d-3111760696ff req-fe517615-df22-4640-8a8a-41e62470dd90 service nova] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:58:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e6dfee3c-0013-40fa-aa8d-3111760696ff req-fe517615-df22-4640-8a8a-41e62470dd90 service nova] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:58:30 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e6dfee3c-0013-40fa-aa8d-3111760696ff req-fe517615-df22-4640-8a8a-41e62470dd90 service nova] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:58:30 user nova-compute[74587]: DEBUG nova.compute.manager [req-e6dfee3c-0013-40fa-aa8d-3111760696ff req-fe517615-df22-4640-8a8a-41e62470dd90 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] No waiting events found dispatching network-vif-plugged-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:58:30 user nova-compute[74587]: WARNING nova.compute.manager [req-e6dfee3c-0013-40fa-aa8d-3111760696ff req-fe517615-df22-4640-8a8a-41e62470dd90 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received unexpected event network-vif-plugged-70ad2896-ff04-464f-b56b-104f49e39c14 for instance with vm_state building and task_state spawning.
Oct 18 07:58:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Instance event wait completed in 0 seconds for  {{(pid=74587) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Guest created on hypervisor {{(pid=74587) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 07:58:32 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Instance spawned successfully.
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Found default for hw_cdrom_bus of ide {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Found default for hw_disk_bus of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Found default for hw_input_bus of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Found default for hw_pointer_model of None {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Found default for hw_video_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Found default for hw_vif_model of virtio {{(pid=74587) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 07:58:32 user nova-compute[74587]: INFO nova.compute.manager [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Took 5.18 seconds to spawn the instance on the hypervisor.
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.compute.manager [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Checking state {{(pid=74587) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 07:58:32 user nova-compute[74587]: INFO nova.compute.manager [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Took 5.69 seconds to build instance.
Oct 18 07:58:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-fea3a30b-35d9-4f28-80c1-b31c6b7dc6af tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.785s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-f8bccfec-a36f-4a44-b61c-a46a61a0a1d7 req-5760bcff-bc58-4e6e-8538-591d125065f3 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received event network-vif-plugged-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f8bccfec-a36f-4a44-b61c-a46a61a0a1d7 req-5760bcff-bc58-4e6e-8538-591d125065f3 service nova] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f8bccfec-a36f-4a44-b61c-a46a61a0a1d7 req-5760bcff-bc58-4e6e-8538-591d125065f3 service nova] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-f8bccfec-a36f-4a44-b61c-a46a61a0a1d7 req-5760bcff-bc58-4e6e-8538-591d125065f3 service nova] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:58:32 user nova-compute[74587]: DEBUG nova.compute.manager [req-f8bccfec-a36f-4a44-b61c-a46a61a0a1d7 req-5760bcff-bc58-4e6e-8538-591d125065f3 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] No waiting events found dispatching network-vif-plugged-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 07:58:32 user nova-compute[74587]: WARNING nova.compute.manager [req-f8bccfec-a36f-4a44-b61c-a46a61a0a1d7 req-5760bcff-bc58-4e6e-8538-591d125065f3 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received unexpected event network-vif-plugged-70ad2896-ff04-464f-b56b-104f49e39c14 for instance with vm_state active and task_state None.
Oct 18 07:58:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:41 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:58:41 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:58:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:58:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:58:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:58:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:58:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:48 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:58:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:49 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:58:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:58:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:58:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:58:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:58:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:58:49 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:58:49 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:58:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:58:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:58:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:53 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:58:53 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 07:58:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:58:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:58:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:58:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:58:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:58:56 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:58:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:58:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:58:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:58:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:58:57 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:58:57 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=25.080528259277344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a027c05d-1121-43fe-9d64-6c8b9418d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:58:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:58:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:58:59 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:58:59 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:58:59 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:59:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:59:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:59:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 07:59:04 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 07:59:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:59:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:59:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:59:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:59:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:59:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:59:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:42 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:59:42 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 07:59:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:59:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:59:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:50 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:59:51 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:59:51 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 07:59:51 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 07:59:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 07:59:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 07:59:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 07:59:51 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 07:59:51 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 07:59:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 07:59:51 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 07:59:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:59:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:54 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:59:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:59:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:59:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:59:56 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:59:56 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 07:59:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:59:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:59:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 07:59:56 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 07:59:57 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:59:57 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 07:59:57 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=25.079776763916016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 07:59:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 07:59:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 07:59:57 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a027c05d-1121-43fe-9d64-6c8b9418d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 07:59:57 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 07:59:57 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 07:59:57 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 07:59:57 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 07:59:57 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 07:59:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 07:59:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 07:59:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 07:59:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 07:59:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 07:59:59 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 07:59:59 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:00:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:00:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:00:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:00:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:00:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:00:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:00:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:00:06 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:00:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:00:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-c777d3c4-5f32-41c9-afbb-f7e9931d04a0 req-fd1f10d1-2450-4c23-bea1-fbed4c9534f0 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received event network-changed-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 08:00:17 user nova-compute[74587]: DEBUG nova.compute.manager [req-c777d3c4-5f32-41c9-afbb-f7e9931d04a0 req-fd1f10d1-2450-4c23-bea1-fbed4c9534f0 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Refreshing instance network info cache due to event network-changed-70ad2896-ff04-464f-b56b-104f49e39c14. {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 08:00:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c777d3c4-5f32-41c9-afbb-f7e9931d04a0 req-fd1f10d1-2450-4c23-bea1-fbed4c9534f0 service nova] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 08:00:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c777d3c4-5f32-41c9-afbb-f7e9931d04a0 req-fd1f10d1-2450-4c23-bea1-fbed4c9534f0 service nova] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 08:00:17 user nova-compute[74587]: DEBUG nova.network.neutron [req-c777d3c4-5f32-41c9-afbb-f7e9931d04a0 req-fd1f10d1-2450-4c23-bea1-fbed4c9534f0 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Refreshing network info cache for port 70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 08:00:17 user nova-compute[74587]: DEBUG nova.network.neutron [req-c777d3c4-5f32-41c9-afbb-f7e9931d04a0 req-fd1f10d1-2450-4c23-bea1-fbed4c9534f0 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updated VIF entry in instance network info cache for port 70ad2896-ff04-464f-b56b-104f49e39c14. {{(pid=74587) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 08:00:17 user nova-compute[74587]: DEBUG nova.network.neutron [req-c777d3c4-5f32-41c9-afbb-f7e9931d04a0 req-fd1f10d1-2450-4c23-bea1-fbed4c9534f0 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 08:00:17 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-c777d3c4-5f32-41c9-afbb-f7e9931d04a0 req-fd1f10d1-2450-4c23-bea1-fbed4c9534f0 service nova] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 08:00:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG nova.objects.instance [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:00:23 user nova-compute[74587]: INFO nova.compute.manager [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attaching volume bc4a1377-9bb0-42b6-ad26-891be73c0687 to /dev/vdb
Oct 18 08:00:23 user nova-compute[74587]: DEBUG os_brick.utils [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b74f236-2fc3-491c-8b48-a69e228a7750]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[24059df2-cfd5-4a47-95fa-b95b131b8c5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[793b055b-78e9-496a-bc2b-d47205fe57b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c870e44-4e34-40a6-9e97-1d19c6645422]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 08:00:23 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 08:00:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef262d40-14d1-4e54-984e-7f11cca37ef3]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG os_brick.utils [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:00:23 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating existing volume attachment record: 361f795d-5c34-43f0-98ea-b58f6f08378d {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 08:00:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsjfbayD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:00:38 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:00:38 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:00:38 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[3475c591-097b-4738-9189-c37b16701fe4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 08:00:38 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8178ec-0771-4911-bd44-42335f76b3ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687] added
Oct 18 08:00:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bfc74f-2438-4449-b35c-5750693ae78a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[17582881-9fe7-48d7-a8ad-ae603bab78dc]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsjfbayD {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsjfbayD" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c4758e-5238-4c89-84e2-4e5dbcbe1893]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QsjfbayD'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad2eba1-511b-460b-850d-1c0acb761fcf]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[588daea3-7c03-4ec4-9965-a7dcdeb10b64]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 08:00:38 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 08:00:38 user nova-compute[74587]:  {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:00:38 user nova-compute[74587]: WARNING os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 08:00:38 user nova-compute[74587]: 
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de4467d-9573-429e-8839-f7042c520e20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687, portal: 172.16.0.220,3260]
Oct 18 08:00:38 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687, portal: 172.16.0.220,3260] successful.
Oct 18 08:00:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2336176-dcd8-4540-8d96-00ac8ba45595]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa846565-93fb-4e7c-96a6-ac447931960a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 (non-flash)
Oct 18 08:00:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 (non-flash)
Oct 18 08:00:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bce706d-bed0-479c-aded-b04eea9e50f6]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:00:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 08:00:39 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 08:00:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsjfbayD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 08:00:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:00:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23436306531643631', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:00:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436306531643631', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 08:00:39 user nova-compute[74587]: DEBUG nova.objects.instance [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:00:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 08:00:39 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:00:39 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:00:39 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:00:39 user nova-compute[74587]:   <serial>bc4a1377-9bb0-42b6-ad26-891be73c0687</serial>
Oct 18 08:00:39 user nova-compute[74587]: </disk>
Oct 18 08:00:39 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 08:00:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 08:00:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 08:00:40 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No VIF found with MAC fa:16:3e:2d:3c:4e, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 08:00:40 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-18fdcd06-0030-4fa2-9d8c-ca8f59133d02 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.053s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:00:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:00:43 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 08:00:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:51 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:00:52 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:00:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 08:00:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 08:00:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 08:00:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 08:00:52 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 08:00:52 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:00:52 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 08:00:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 08:00:52 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 08:00:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:00:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74587) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 08:00:59 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:00:59 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:00:59 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=25.070709228515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 08:00:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:00:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:00:59 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a027c05d-1121-43fe-9d64-6c8b9418d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 08:00:59 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 08:00:59 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 08:00:59 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 08:00:59 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 08:00:59 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 08:00:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:01:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:01:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:01:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:01:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:01:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:01:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:01:11 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:01:11 user nova-compute[74587]: INFO nova.compute.manager [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Detaching volume bc4a1377-9bb0-42b6-ad26-891be73c0687
Oct 18 08:01:11 user nova-compute[74587]: INFO nova.virt.block_device [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attempting to driver detach volume bc4a1377-9bb0-42b6-ad26-891be73c0687 from mountpoint /dev/vdb
Oct 18 08:01:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Attempting to detach device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 08:01:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 08:01:11 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:01:11 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:01:11 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:01:11 user nova-compute[74587]:   <serial>bc4a1377-9bb0-42b6-ad26-891be73c0687</serial>
Oct 18 08:01:11 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 08:01:11 user nova-compute[74587]: </disk>
Oct 18 08:01:11 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 08:01:11 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Successfully detached device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the persistent domain config.
Oct 18 08:01:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 08:01:11 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 08:01:11 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:01:11 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:01:11 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:01:11 user nova-compute[74587]:   <serial>bc4a1377-9bb0-42b6-ad26-891be73c0687</serial>
Oct 18 08:01:11 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 08:01:11 user nova-compute[74587]: </disk>
Oct 18 08:01:11 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 08:01:12 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 08:01:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:01:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:01:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:01:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:01:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:32 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a027c05d-1121-43fe-9d64-6c8b9418d426 is timed out.
Oct 18 08:01:32 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Successfully detached device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the live domain config.
Oct 18 08:01:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsjfbayD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:01:32 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ac26de-c24c-4585-9c99-b0aee7579fff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 08:01:32 user nova-compute[74587]: No targets found.
Oct 18 08:01:32 user nova-compute[74587]: iSNS:
Oct 18 08:01:32 user nova-compute[74587]: No targets found.
Oct 18 08:01:32 user nova-compute[74587]: STATIC:
Oct 18 08:01:32 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687
Oct 18 08:01:32 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 08:01:32 user nova-compute[74587]:                 Iface Name: default
Oct 18 08:01:32 user nova-compute[74587]: FIRMWARE:
Oct 18 08:01:32 user nova-compute[74587]: No targets found.
Oct 18 08:01:32 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 08:01:32 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 08:01:32 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[406772e7-90a0-4fd3-a7c8-238f623027b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea67ff0-4015-4a2a-9679-b8fd715d9fc4]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 (non-flash)
Oct 18 08:01:32 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 (non-flash)
Oct 18 08:01:32 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4504040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b3d75-8cf1-4c31-9cb5-665cec3af9f9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c90d5d-b654-4a52-b98b-a9d4eebb9167]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[594677d7-9be8-4e5a-a167-e9f33f275ba5]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[100ecdf6-3fd7-4d8d-a0e0-ff4b041c0cef]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b8122a-206a-47ae-8633-0a8947472236]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13b556f-5c3f-430f-a3a9-8e471f394a76]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687, portal: 172.16.0.220,3260]
Oct 18 08:01:32 user nova-compute[74587]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687, portal: 172.16.0.220,3260] successful.
Oct 18 08:01:32 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4a1377-9bb0-42b6-ad26-891be73c0687 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f81f2ca-2c6f-4be4-b9db-d30d92a5b11c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== disconnect_volume: return (311ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:01:32 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 08:01:33 user nova-compute[74587]: DEBUG nova.objects.instance [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:01:33 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-c4dea485-1df5-4fe7-a905-0f89efa91ad1 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.802s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:01:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:01:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:01:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:43 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:01:43 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 08:01:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:01:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 08:01:53 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:01:57 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:01:58 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:01:59 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:01:59 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:01:59 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.069927215576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 08:01:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:01:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:01:59 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a027c05d-1121-43fe-9d64-6c8b9418d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 08:01:59 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 08:01:59 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 08:01:59 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 08:01:59 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 08:01:59 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 08:01:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:02:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:02:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:02:01 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:02:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:02:05 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:02:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:02:06 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:02:06 user nova-compute[74587]: DEBUG nova.objects.instance [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:02:07 user nova-compute[74587]: INFO nova.compute.manager [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attaching volume 3f551b6a-d08c-46a3-a820-efc5c1f84c79 to /dev/vdb
Oct 18 08:02:07 user nova-compute[74587]: DEBUG os_brick.utils [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb33df-e15b-4fe1-8e5e-5e70e7d494ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[87772f95-131a-45df-b5b8-53ca2984d9fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c85639d-08c7-4b6a-a0df-cd0b57160354]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc53ee51-4ef6-4e2f-9dc0-1373f0328b45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 08:02:07 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 08:02:07 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4202589-e4ee-4fdf-8eac-5fabe51097b6]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG os_brick.utils [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:02:07 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating existing volume attachment record: 3b5b0881-60b8-40c0-89fa-0f5fd333335f {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 08:02:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:02:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:02:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TutbhBqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:02:22 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:02:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:02:22 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:02:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:02:22 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d2e939-1c32-4e9d-946e-de35a48005a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 08:02:22 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e505cb6d-18d9-426a-bbe4-745f503e38ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79] added
Oct 18 08:02:22 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[317b0328-f3eb-47d2-a02f-eeaf225cf035]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7962e4a3-fbc5-4e4d-bfd7-cf54604acfe5]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TutbhBqI {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TutbhBqI" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[67938b8a-56fb-4e62-8d0c-728efeae700e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TutbhBqI'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd64ad99-d9cc-42fa-a452-82bde0dd2299]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[902bf038-5a33-4aeb-95ae-a597bbd60348]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 08:02:23 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 08:02:23 user nova-compute[74587]:  {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:02:23 user nova-compute[74587]: WARNING os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 08:02:23 user nova-compute[74587]: 
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[497a8801-b129-4032-b7c6-54a9680b17a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79, portal: 172.16.0.220,3260]
Oct 18 08:02:23 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79, portal: 172.16.0.220,3260] successful.
Oct 18 08:02:23 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[758a968d-9cc0-432f-9fe3-2ede05a312fa]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6ce785-185e-4e4b-95c1-e92af25e6303]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 (non-flash)
Oct 18 08:02:23 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 (non-flash)
Oct 18 08:02:23 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df4b3a4-3fac-4c29-94fa-5e261b86c3d1]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TutbhBqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23165386334653633', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165386334653633', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG nova.objects.instance [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 08:02:24 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:02:24 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:02:24 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:02:24 user nova-compute[74587]:   <serial>3f551b6a-d08c-46a3-a820-efc5c1f84c79</serial>
Oct 18 08:02:24 user nova-compute[74587]: </disk>
Oct 18 08:02:24 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No VIF found with MAC fa:16:3e:2d:3c:4e, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 08:02:24 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-db994c07-9782-420c-8147-605b91d86be6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.524s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:02:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:02:27 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:02:27 user nova-compute[74587]: INFO nova.compute.manager [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Detaching volume 3f551b6a-d08c-46a3-a820-efc5c1f84c79
Oct 18 08:02:27 user nova-compute[74587]: INFO nova.virt.block_device [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attempting to driver detach volume 3f551b6a-d08c-46a3-a820-efc5c1f84c79 from mountpoint /dev/vdb
Oct 18 08:02:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Attempting to detach device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 08:02:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 08:02:27 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:02:27 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:02:27 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:02:27 user nova-compute[74587]:   <serial>3f551b6a-d08c-46a3-a820-efc5c1f84c79</serial>
Oct 18 08:02:27 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 08:02:27 user nova-compute[74587]: </disk>
Oct 18 08:02:27 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 08:02:27 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Successfully detached device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the persistent domain config.
Oct 18 08:02:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 08:02:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 08:02:27 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:02:27 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:02:27 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:02:27 user nova-compute[74587]:   <serial>3f551b6a-d08c-46a3-a820-efc5c1f84c79</serial>
Oct 18 08:02:27 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 08:02:27 user nova-compute[74587]: </disk>
Oct 18 08:02:27 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 08:02:27 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 08:02:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:02:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:02:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:02:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:02:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:44 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:02:44 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 08:02:47 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a027c05d-1121-43fe-9d64-6c8b9418d426 is timed out.
Oct 18 08:02:47 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Successfully detached device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the live domain config.
Oct 18 08:02:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TutbhBqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:02:47 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[93301ab7-cb6c-45b5-ab98-eebf2880b1b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 08:02:47 user nova-compute[74587]: No targets found.
Oct 18 08:02:47 user nova-compute[74587]: iSNS:
Oct 18 08:02:47 user nova-compute[74587]: No targets found.
Oct 18 08:02:47 user nova-compute[74587]: STATIC:
Oct 18 08:02:47 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79
Oct 18 08:02:47 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 08:02:47 user nova-compute[74587]:                 Iface Name: default
Oct 18 08:02:47 user nova-compute[74587]: FIRMWARE:
Oct 18 08:02:47 user nova-compute[74587]: No targets found.
Oct 18 08:02:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 08:02:47 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 08:02:47 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b601472-065a-4ce4-b320-45044368c5d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd8fce-f4c9-4d0e-8049-2aee09e79d38]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 (non-flash)
Oct 18 08:02:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 (non-flash)
Oct 18 08:02:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f100860c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8164f073-d116-43f9-bef3-a85f8664dacb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a541952c-c356-4101-9dc1-445587e109fd]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[499eead9-9d9d-46cf-943c-a1cd2024dd85]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f203612e-25b7-4ef3-b465-af87ea47f6e8]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5c4f56-c05a-4a95-8811-be0808998cca]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aab7257-f1a5-43bf-b4a2-ae538f57025f]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79, portal: 172.16.0.220,3260]
Oct 18 08:02:47 user nova-compute[74587]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79, portal: 172.16.0.220,3260] successful.
Oct 18 08:02:47 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f551b6a-d08c-46a3-a820-efc5c1f84c79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f53dc9-65e7-4b23-8637-02512379f27c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== disconnect_volume: return (297ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:02:47 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 08:02:48 user nova-compute[74587]: DEBUG nova.objects.instance [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:02:48 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-d65ed457-ac70-4f76-a964-24f13b57cff6 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:02:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:02:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:02:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:02:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:02:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 08:02:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:02:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:02:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:02:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:02:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:02:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:03:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:03:00 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 08:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:03:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:03:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.06882095336914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 08:03:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:03:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:03:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a027c05d-1121-43fe-9d64-6c8b9418d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 08:03:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 08:03:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 08:03:01 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 08:03:01 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 08:03:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 08:03:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:03:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:03:05 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:03:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:03:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:03:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:03:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:03:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:03:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:03:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:03:22 user nova-compute[74587]: INFO nova.compute.manager [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attaching volume 95ddc5fc-344e-4c01-9361-d5eceb7671a4 to /dev/vdb
Oct 18 08:03:22 user nova-compute[74587]: DEBUG os_brick.utils [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48719a7-c00d-46ed-a807-a3a6edf42237]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3f229e-9322-41bf-8332-0638bec33d5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde5f3bb-fa4d-4566-81d2-23edd3c11679]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86d791e-16b1-43c1-8726-920cebfe0ed6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 08:03:22 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 08:03:22 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43f37c8-3cbf-43ac-a7c3-351798f677cc]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG os_brick.utils [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:03:22 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating existing volume attachment record: e7d72db2-0dbd-420a-b8ac-b3873300eb39 {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 08:03:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:03:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:03:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:03:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfwDmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:03:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:03:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:03:37 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:03:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:03:37 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b22d6ac-2cbc-41bd-8a9c-78c875806c88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 08:03:37 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed836c0-7c64-4120-b272-39fe6b8e9c9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4] added
Oct 18 08:03:37 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a428203a-911d-4e8b-9e7c-7a0c6f637efa]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6400ef18-281f-4256-9073-298c5ceb6ade]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFsfwDmo {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFsfwDmo" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9977f7bf-c60e-49dc-9040-7c58f0a2d352]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eFsfwDmo'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:03:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[366a4fb9-de35-4baf-a29b-5ea1f1240490]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1862c4fb-26ad-4664-9b73-63d136f1eb2f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 08:03:38 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 08:03:38 user nova-compute[74587]:  {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:03:38 user nova-compute[74587]: WARNING os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 08:03:38 user nova-compute[74587]: 
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb1ca4e-c542-4d46-94cd-221727adae16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4, portal: 172.16.0.220,3260]
Oct 18 08:03:38 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4, portal: 172.16.0.220,3260] successful.
Oct 18 08:03:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[284edb2b-bb96-4b74-ae46-b60b83ce7e5e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7f4a81-8c3a-4e41-99b8-71e7750ddc1c]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 (non-flash)
Oct 18 08:03:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 (non-flash)
Oct 18 08:03:38 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[560ee9c4-8e2e-4d46-a525-a47caa22959b]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfwDmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 08:03:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:03:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:03:39 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23362616563653334', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:03:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362616563653334', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 08:03:39 user nova-compute[74587]: DEBUG nova.objects.instance [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:03:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 08:03:39 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:03:39 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:03:39 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:03:39 user nova-compute[74587]:   <serial>95ddc5fc-344e-4c01-9361-d5eceb7671a4</serial>
Oct 18 08:03:39 user nova-compute[74587]: </disk>
Oct 18 08:03:39 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 08:03:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 08:03:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 08:03:39 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No VIF found with MAC fa:16:3e:2d:3c:4e, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 08:03:39 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-f81fa332-3da2-42d5-a78d-a1e5b2ea6359 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.459s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:03:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:03:42 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:03:42 user nova-compute[74587]: INFO nova.compute.manager [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Detaching volume 95ddc5fc-344e-4c01-9361-d5eceb7671a4
Oct 18 08:03:42 user nova-compute[74587]: INFO nova.virt.block_device [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attempting to driver detach volume 95ddc5fc-344e-4c01-9361-d5eceb7671a4 from mountpoint /dev/vdb
Oct 18 08:03:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Attempting to detach device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 08:03:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 08:03:42 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:03:42 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:03:42 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:03:42 user nova-compute[74587]:   <serial>95ddc5fc-344e-4c01-9361-d5eceb7671a4</serial>
Oct 18 08:03:42 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 08:03:42 user nova-compute[74587]: </disk>
Oct 18 08:03:42 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 08:03:42 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Successfully detached device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the persistent domain config.
Oct 18 08:03:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 08:03:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 08:03:42 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:03:42 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:03:42 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:03:42 user nova-compute[74587]:   <serial>95ddc5fc-344e-4c01-9361-d5eceb7671a4</serial>
Oct 18 08:03:42 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 08:03:42 user nova-compute[74587]: </disk>
Oct 18 08:03:42 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 08:03:42 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 08:03:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:03:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:03:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 08:03:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:03:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:03:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:55 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:55 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74587) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 08:03:57 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:03:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 08:03:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 08:03:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 08:03:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 08:03:57 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 08:03:57 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:03:57 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 08:03:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 08:03:57 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 08:03:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:03:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:03:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:03:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:03:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:03:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:03:59 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:04:00 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 08:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:04:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=25.067855834960938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a027c05d-1121-43fe-9d64-6c8b9418d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing inventories for resource provider 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating ProviderTree inventory for provider 397368dc-ec08-427c-87a9-228e852f6a40 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Updating inventory in ProviderTree for provider 397368dc-ec08-427c-87a9-228e852f6a40 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing aggregate associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, aggregates: None {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Refreshing trait associations for resource provider 397368dc-ec08-427c-87a9-228e852f6a40, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND {{(pid=74587) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 08:04:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:02 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a027c05d-1121-43fe-9d64-6c8b9418d426 is timed out.
Oct 18 08:04:02 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Successfully detached device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the live domain config.
Oct 18 08:04:02 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFsfwDmo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:04:02 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:04:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab4debe-92ff-4cc8-bd6d-68d0c1ce29f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 08:04:02 user nova-compute[74587]: No targets found.
Oct 18 08:04:02 user nova-compute[74587]: iSNS:
Oct 18 08:04:02 user nova-compute[74587]: No targets found.
Oct 18 08:04:02 user nova-compute[74587]: STATIC:
Oct 18 08:04:02 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4
Oct 18 08:04:02 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 08:04:02 user nova-compute[74587]:                 Iface Name: default
Oct 18 08:04:02 user nova-compute[74587]: FIRMWARE:
Oct 18 08:04:02 user nova-compute[74587]: No targets found.
Oct 18 08:04:02 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 08:04:02 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 08:04:02 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[30be82c4-df42-4f4c-a2eb-aeb1a599f23e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1731ab-c453-472c-ae47-3457bd6efb55]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 (non-flash)
Oct 18 08:04:02 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 (non-flash)
Oct 18 08:04:02 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe4537520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 08:04:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[9132ed9c-0378-40c4-81ab-320d9f8cd6e3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[196b6a7e-4b1b-491c-b7be-4bfa1cd6191b]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbab060-c1e6-4a18-b7bf-9850973e0836]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e42ba7e-988d-4958-9ead-1801f19d71e4]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[396df90c-fbef-49dd-9707-8d11718bae6c]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[760c7c3e-a521-46d1-ac3f-192f5195d745]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4, portal: 172.16.0.220,3260]
Oct 18 08:04:03 user nova-compute[74587]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4, portal: 172.16.0.220,3260] successful.
Oct 18 08:04:03 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95ddc5fc-344e-4c01-9361-d5eceb7671a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[75565d65-08cf-4471-a6b7-d8bfe14c0693]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== disconnect_volume: return (281ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:04:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:04 user nova-compute[74587]: DEBUG nova.objects.instance [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:04:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-e313f035-6e49-4dad-87d1-1f3144629d3c tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:04:06 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:04:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:04:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:04:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:12 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Cleaning up deleted instances {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 08:04:12 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] There are 0 instances to clean {{(pid=74587) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 08:04:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:04:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:04:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:04:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:04:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:04:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:04:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:27 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG nova.objects.instance [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:04:37 user nova-compute[74587]: INFO nova.compute.manager [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attaching volume a140c615-1df4-46c0-8fd2-18a48a31e731 to /dev/vdb
Oct 18 08:04:37 user nova-compute[74587]: DEBUG os_brick.utils [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f4bb68-c4a4-427f-a06e-f0d466f5cee9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e3c21bee93d\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71635fe-b215-4e16-ab5c-8a5024bca6fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da62298-0ea4-425f-9295-8cfa4e2182d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[596bd978-2727-4645-b79e-4b5b322114a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Running cmd (subprocess): nvme version {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] nvme not present on system {{(pid=74587) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 08:04:37 user nova-compute[74587]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 08:04:37 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[637fd08a-e752-4f76-a747-a45619faa249]: (4, '') {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74587) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.lightos [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] LIGHTOS: no hostnqn found. {{(pid=74587) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG os_brick.utils [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e3c21bee93d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:04:37 user nova-compute[74587]: DEBUG nova.virt.block_device [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating existing volume attachment record: fdeb8e08-1065-4c73-87e5-c65324548e1d {{(pid=74587) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 08:04:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:38 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:38 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Triggering sync for uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 08:04:38 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:04:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:04:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:04:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:04:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:45 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:45 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 08:04:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Calling os-brick to attach iSCSI Volume {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcIKstve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:04:53 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:04:53 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:04:53 user nova-compute[74587]: INFO os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee24b83-57be-4e07-8435-4a9a87f566d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 08:04:53 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --interface default --op new {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6fbec3-1d54-4128-915f-092a39d3d6bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731] added\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731] added
Oct 18 08:04:53 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088b387-63ab-401c-8e10-48643137eedb]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b37ced7-d6fd-4de6-afcd-39456d22da5f]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcIKstve {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcIKstve" returned: 0 in 0.025s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[611aad5b-9e2f-4872-a8cd-b069328faa6a]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcIKstve'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a7162-2051-42a9-9587-6b68388f446e]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[157907ff-0d7b-4f06-843d-6cc6a8e6f19c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 08:04:53 user nova-compute[74587]:  {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 08:04:53 user nova-compute[74587]:  {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:04:53 user nova-compute[74587]: WARNING os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 08:04:53 user nova-compute[74587]: 
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --login {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7019e7-9408-4fff-bfc8-90618b6e5fe4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731, portal: 172.16.0.220,3260]
Oct 18 08:04:53 user nova-compute[74587]: Login to [iface: default, target: iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731, portal: 172.16.0.220,3260] successful.
Oct 18 08:04:53 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[355fc686-4844-4e87-b1a8-3bba37ad49ef]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d05844-2120-4e3f-a08e-2b023b4f5cd1]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 (non-flash)
Oct 18 08:04:53 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 (non-flash)
Oct 18 08:04:53 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Connected to 172.16.0.220:3260 {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74587) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74587) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e41133-0dd3-40dc-9c50-1707f5119a29]: (4, ('- - 0', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 08:04:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:04:54 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74587) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 08:04:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcIKstve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74587) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 08:04:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:04:54 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26633353064363238', 'path': '/dev/sdb'} {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:04:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633353064363238', 'path': '/dev/sdb'} {{(pid=74587) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 08:04:54 user nova-compute[74587]: DEBUG nova.objects.instance [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:04:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 08:04:54 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:04:54 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:04:54 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:04:54 user nova-compute[74587]:   <serial>a140c615-1df4-46c0-8fd2-18a48a31e731</serial>
Oct 18 08:04:54 user nova-compute[74587]: </disk>
Oct 18 08:04:54 user nova-compute[74587]:  {{(pid=74587) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 08:04:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 08:04:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74587) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 08:04:54 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] No VIF found with MAC fa:16:3e:2d:3c:4e, not building metadata {{(pid=74587) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 08:04:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-2d37a1d4-8c5b-459d-a957-65ac2b713907 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.358s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:04:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.454s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:04:55 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:04:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:04:57 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:04:57 user nova-compute[74587]: INFO nova.compute.manager [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Detaching volume a140c615-1df4-46c0-8fd2-18a48a31e731
Oct 18 08:04:57 user nova-compute[74587]: INFO nova.virt.block_device [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Attempting to driver detach volume a140c615-1df4-46c0-8fd2-18a48a31e731 from mountpoint /dev/vdb
Oct 18 08:04:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Attempting to detach device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the persistent domain config. {{(pid=74587) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 08:04:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 08:04:57 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:04:57 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:04:57 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:04:57 user nova-compute[74587]:   <serial>a140c615-1df4-46c0-8fd2-18a48a31e731</serial>
Oct 18 08:04:57 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 08:04:57 user nova-compute[74587]: </disk>
Oct 18 08:04:57 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 08:04:57 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Successfully detached device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the persistent domain config.
Oct 18 08:04:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the live domain config. {{(pid=74587) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 08:04:57 user nova-compute[74587]: DEBUG nova.virt.libvirt.guest [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 08:04:57 user nova-compute[74587]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 08:04:57 user nova-compute[74587]:   <source dev="/dev/sdb"/>
Oct 18 08:04:57 user nova-compute[74587]:   <target dev="vdb" bus="virtio"/>
Oct 18 08:04:57 user nova-compute[74587]:   <serial>a140c615-1df4-46c0-8fd2-18a48a31e731</serial>
Oct 18 08:04:57 user nova-compute[74587]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 08:04:57 user nova-compute[74587]: </disk>
Oct 18 08:04:57 user nova-compute[74587]:  {{(pid=74587) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 08:04:58 user nova-compute[74587]: DEBUG nova.virt.libvirt.driver [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 08:04:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:04:59 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:04:59 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 08:04:59 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 08:04:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 08:04:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 08:04:59 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 08:04:59 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:04:59 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 08:04:59 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 08:04:59 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 08:05:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:05:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:05:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:05:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:05:00 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 08:05:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:00 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:05:01 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:05:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=25.066768646240234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 08:05:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:05:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:05:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a027c05d-1121-43fe-9d64-6c8b9418d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 08:05:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 08:05:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 08:05:01 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 08:05:01 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 08:05:01 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 08:05:01 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:05:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:05:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:05:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:05:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:05:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:05:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:05:11 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:05:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:05:18 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a027c05d-1121-43fe-9d64-6c8b9418d426 is timed out.
Oct 18 08:05:18 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Successfully detached device vdb from instance a027c05d-1121-43fe-9d64-6c8b9418d426 from the live domain config.
Oct 18 08:05:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] calling os-brick to detach iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f10082592a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcIKstve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 08:05:18 user nova-compute[74587]: WARNING os_brick.initiator.connectors.base [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a38bbd-6435-4c30-9ad7-7e3286cb4e6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 08:05:18 user nova-compute[74587]: No targets found.
Oct 18 08:05:18 user nova-compute[74587]: iSNS:
Oct 18 08:05:18 user nova-compute[74587]: No targets found.
Oct 18 08:05:18 user nova-compute[74587]: STATIC:
Oct 18 08:05:18 user nova-compute[74587]: Target: iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731
Oct 18 08:05:18 user nova-compute[74587]:         Portal: 172.16.0.220:3260,-1
Oct 18 08:05:18 user nova-compute[74587]:                 Iface Name: default
Oct 18 08:05:18 user nova-compute[74587]: FIRMWARE:
Oct 18 08:05:18 user nova-compute[74587]: No targets found.
Oct 18 08:05:18 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 08:05:18 user nova-compute[74587]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 08:05:18 user nova-compute[74587]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74587) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731', 0)] {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[130c867d-5291-4ff3-bc0f-8b6a81f53fa2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[0055e64a-91fc-4c20-9dd9-68cae77ecb50]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 (non-flash)\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 (non-flash)
Oct 18 08:05:18 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 (non-flash)
Oct 18 08:05:18 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0fe46af5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731'): ({'sdb'}, set())}) {{(pid=74587) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Removing single pathed devices sdb {{(pid=74587) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e70142-15c4-4595-8446-a3951f59392d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ba7ab1-5a62-4d45-b094-a41658b6509b]: (4, ('ok\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Flushing IO for device /dev/sdb {{(pid=74587) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[f203cca6-a7c7-4398-9742-dc97d1b6456b]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74587) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc91feee-294b-4a51-9583-6e099a0e9304]: (4, ('1', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.linuxscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] SCSI volumes sdb have been removed. {{(pid=74587) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731')] {{(pid=74587) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[2229d643-7a41-4ba6-b346-da20a54a9b7d]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --logout {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f19b28-c6a8-49c6-ab3d-42c95c19ac3e]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731, portal: 172.16.0.220,3260]
Oct 18 08:05:18 user nova-compute[74587]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731, portal: 172.16.0.220,3260] successful.
Oct 18 08:05:18 user nova-compute[74587]:  stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op delete {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a140c615-1df4-46c0-8fd2-18a48a31e731 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85802) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG oslo.privsep.daemon [-] privsep: reply[145960ce-0726-40b0-958f-0cb29eed5033]: (4, ('', '')) {{(pid=85802) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74587) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.base [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG os_brick.initiator.connectors.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] <== disconnect_volume: return (282ms) None {{(pid=74587) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG nova.virt.libvirt.volume.iscsi [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Disconnected iSCSI Volume {{(pid=74587) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:05:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:05:19 user nova-compute[74587]: DEBUG nova.objects.instance [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'flavor' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:05:19 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-263c2c52-8130-4631-be93-6b643bc961b3 tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.726s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:05:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:05:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:05:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:05:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:05:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:05:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:05:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:05:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:05:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:05:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:05:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:05:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:05:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:05:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:05:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:05:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:05:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:05:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:05:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:05:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:05:47 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:05:47 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 08:05:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:05:53 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:05:56 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:05:58 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:06:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 08:06:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 08:06:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 08:06:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquired lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 08:06:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Forcefully refreshing network info cache for instance {{(pid=74587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 08:06:00 user nova-compute[74587]: DEBUG nova.objects.instance [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lazy-loading 'info_cache' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:06:00 user nova-compute[74587]: DEBUG nova.network.neutron [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [{"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 08:06:00 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Releasing lock "refresh_cache-a027c05d-1121-43fe-9d64-6c8b9418d426" {{(pid=74587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 08:06:00 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updated the network info_cache for instance {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 08:06:02 user nova-compute[74587]: DEBUG oslo_concurrency.processutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 08:06:03 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:06:03 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:06:03 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.066024780273438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Instance a027c05d-1121-43fe-9d64-6c8b9418d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74587) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:06:03 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:06:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:06:08 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:09 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:06:13 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:06:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:06:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:06:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:06:13 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:06:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:06:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:06:18 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:06:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:06:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:06:23 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:28 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:33 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:38 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:48 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:06:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 08:06:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:06:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:06:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:06:48 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:06:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:06:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:06:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:06:49 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:06:49 user nova-compute[74587]: INFO nova.compute.manager [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Terminating instance
Oct 18 08:06:49 user nova-compute[74587]: DEBUG nova.compute.manager [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Start destroying the instance on the hypervisor. {{(pid=74587) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 08:06:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:49 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-405b50d4-8604-4997-aa10-cc8a0336c07d req-26810d72-cbac-4c8e-8b96-8469e378b390 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received event network-vif-unplugged-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-405b50d4-8604-4997-aa10-cc8a0336c07d req-26810d72-cbac-4c8e-8b96-8469e378b390 service nova] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-405b50d4-8604-4997-aa10-cc8a0336c07d req-26810d72-cbac-4c8e-8b96-8469e378b390 service nova] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-405b50d4-8604-4997-aa10-cc8a0336c07d req-26810d72-cbac-4c8e-8b96-8469e378b390 service nova] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-405b50d4-8604-4997-aa10-cc8a0336c07d req-26810d72-cbac-4c8e-8b96-8469e378b390 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] No waiting events found dispatching network-vif-unplugged-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG nova.compute.manager [req-405b50d4-8604-4997-aa10-cc8a0336c07d req-26810d72-cbac-4c8e-8b96-8469e378b390 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received event network-vif-unplugged-70ad2896-ff04-464f-b56b-104f49e39c14 for instance with task_state deleting. {{(pid=74587) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [-] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Instance destroyed successfully.
Oct 18 08:06:50 user nova-compute[74587]: DEBUG nova.objects.instance [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lazy-loading 'resources' on Instance uuid a027c05d-1121-43fe-9d64-6c8b9418d426 {{(pid=74587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG nova.virt.libvirt.vif [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T07:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1952977357',display_name='tempest-SnapshotDataIntegrityTests-server-1952977357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1952977357',id=52,image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEkxVwjh+BGgrb7vxNx1JUbc2z1FrbrjDU/s4r1v656853if5aovLj/QrhEPWrm+0koWWk7iyQv5hX0Iem3kZiS0MVZaqzj5MgeClnd5Q+OsRlEnkIjMVAqS5GwXvIyxg==',key_name='tempest-keypair-1301779139',keypairs=<?>,launch_index=0,launched_at=2023-10-18T07:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912259b5c6c4446aa7669ccd59265bd1',ramdisk_id='',reservation_id='r-bj0k09mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9442f4c2-6355-454c-90aa-9dccf102d343',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-399313967',owner_user_name='tempest-SnapshotDataIntegrityTests-399313967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T07:58:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3065922317434d8b88e912f35a026fd1',uuid=a027c05d-1121-43fe-9d64-6c8b9418d426,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Converting VIF {"id": "70ad2896-ff04-464f-b56b-104f49e39c14", "address": "fa:16:3e:2d:3c:4e", "network": {"id": "ed7a3bf7-ccc0-469d-b725-1db99574beb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-538970810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912259b5c6c4446aa7669ccd59265bd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ad2896-ff", "ovs_interfaceid": "70ad2896-ff04-464f-b56b-104f49e39c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG nova.network.os_vif_util [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:3c:4e,bridge_name='br-int',has_traffic_filtering=True,id=70ad2896-ff04-464f-b56b-104f49e39c14,network=Network(ed7a3bf7-ccc0-469d-b725-1db99574beb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ad2896-ff') {{(pid=74587) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG os_vif [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:3c:4e,bridge_name='br-int',has_traffic_filtering=True,id=70ad2896-ff04-464f-b56b-104f49e39c14,network=Network(ed7a3bf7-ccc0-469d-b725-1db99574beb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ad2896-ff') {{(pid=74587) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70ad2896-ff, bridge=br-int, if_exists=True) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30329685-1648-4cf8-b0da-519a147b9b33) {{(pid=74587) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:06:50 user nova-compute[74587]: INFO os_vif [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:3c:4e,bridge_name='br-int',has_traffic_filtering=True,id=70ad2896-ff04-464f-b56b-104f49e39c14,network=Network(ed7a3bf7-ccc0-469d-b725-1db99574beb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ad2896-ff')
Oct 18 08:06:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Deleting instance files /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426_del
Oct 18 08:06:50 user nova-compute[74587]: INFO nova.virt.libvirt.driver [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Deletion of /opt/stack/data/nova/instances/a027c05d-1121-43fe-9d64-6c8b9418d426_del complete
Oct 18 08:06:50 user nova-compute[74587]: INFO nova.compute.manager [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 18 08:06:50 user nova-compute[74587]: DEBUG oslo.service.loopingcall [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74587) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG nova.compute.manager [-] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Deallocating network for instance {{(pid=74587) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 08:06:50 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] deallocate_for_instance() {{(pid=74587) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 08:06:51 user nova-compute[74587]: DEBUG nova.network.neutron [-] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Updating instance_info_cache with network_info: [] {{(pid=74587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 08:06:51 user nova-compute[74587]: INFO nova.compute.manager [-] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Took 0.62 seconds to deallocate network for instance.
Oct 18 08:06:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:06:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:06:51 user nova-compute[74587]: DEBUG nova.compute.manager [req-50cbea75-e700-464d-93e0-2b004ad78939 req-6977c06e-c802-4a9d-b547-4937498d00e3 service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received event network-vif-deleted-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 08:06:51 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 08:06:51 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 08:06:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:06:51 user nova-compute[74587]: INFO nova.scheduler.client.report [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Deleted allocations for instance a027c05d-1121-43fe-9d64-6c8b9418d426
Oct 18 08:06:51 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-52321e26-2f7a-4e97-94f3-16d669ed1dcc tempest-SnapshotDataIntegrityTests-399313967 tempest-SnapshotDataIntegrityTests-399313967-project-member] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.840s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:06:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-e30c3244-a929-4afe-8c65-d90e28e6d5ae req-9ed0df23-597b-4586-b97b-68e775484d8c service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received event network-vif-plugged-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 08:06:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e30c3244-a929-4afe-8c65-d90e28e6d5ae req-9ed0df23-597b-4586-b97b-68e775484d8c service nova] Acquiring lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:06:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e30c3244-a929-4afe-8c65-d90e28e6d5ae req-9ed0df23-597b-4586-b97b-68e775484d8c service nova] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:06:52 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [req-e30c3244-a929-4afe-8c65-d90e28e6d5ae req-9ed0df23-597b-4586-b97b-68e775484d8c service nova] Lock "a027c05d-1121-43fe-9d64-6c8b9418d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:06:52 user nova-compute[74587]: DEBUG nova.compute.manager [req-e30c3244-a929-4afe-8c65-d90e28e6d5ae req-9ed0df23-597b-4586-b97b-68e775484d8c service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] No waiting events found dispatching network-vif-plugged-70ad2896-ff04-464f-b56b-104f49e39c14 {{(pid=74587) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 08:06:52 user nova-compute[74587]: WARNING nova.compute.manager [req-e30c3244-a929-4afe-8c65-d90e28e6d5ae req-9ed0df23-597b-4586-b97b-68e775484d8c service nova] [instance: a027c05d-1121-43fe-9d64-6c8b9418d426] Received unexpected event network-vif-plugged-70ad2896-ff04-464f-b56b-104f49e39c14 for instance with vm_state deleted and task_state None.
Oct 18 08:06:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:06:58 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:07:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:07:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:07:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 08:07:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 08:07:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 08:07:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:07:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:07:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 08:07:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:07:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:07:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=25.093143463134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 08:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:07:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:07:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:07:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:07:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:07:09 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:07:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:07:14 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:07:15 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:07:20 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:07:25 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:07:30 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:07:35 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:07:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:07:40 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:07:43 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:07:45 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:07:46 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:07:48 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:07:48 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74587) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 08:07:50 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:07:55 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:08:00 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:08:00 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:08:02 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:08:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Starting heal instance info cache {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 08:08:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Rebuilding the list of instances to heal {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 08:08:02 user nova-compute[74587]: DEBUG nova.compute.manager [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Didn't find any instances for network info cache update. {{(pid=74587) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 08:08:03 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Auditing locally available compute resources for user (node: user) {{(pid=74587) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 08:08:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:08:04 user nova-compute[74587]: WARNING nova.virt.libvirt.driver [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 08:08:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Hypervisor/Node resource view: name=user free_ram=9249MB free_disk=25.09060287475586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74587) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74587) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG nova.compute.provider_tree [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed in ProviderTree for provider: 397368dc-ec08-427c-87a9-228e852f6a40 {{(pid=74587) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG nova.scheduler.client.report [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Inventory has not changed for provider 397368dc-ec08-427c-87a9-228e852f6a40 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74587) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG nova.compute.resource_tracker [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Compute_service record updated for user:user {{(pid=74587) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 08:08:04 user nova-compute[74587]: DEBUG oslo_concurrency.lockutils [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=74587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 08:08:05 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:08:06 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:08:07 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:08:08 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:08:10 user nova-compute[74587]: DEBUG oslo_service.periodic_task [None req-0b68838b-e44c-41e0-9750-bf38d7754e55 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74587) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 08:08:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 08:08:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 08:08:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74587) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 08:08:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:08:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74587) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 08:08:10 user nova-compute[74587]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74587) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}